00000001:02000400:2.0F:1788748134.607579:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788748153.898899:0:3512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788748156.573791:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 379 MB/s 00000001:01000000:0.0:1788748156.830440:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 354 MB/s 00000001:01000000:3.0:1788748157.080522:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3500 MB/s 00000020:02000000:0.0:1788748157.693665:0:3604:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_41_g2290de3 00000400:02000000:3.0:1788748158.551839:0:3619:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.122@tcp [8/256/0/180] 00008000:02000000:0.0:1788748163.362356:0:3769:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788748225.520191:0:5737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788748237.993675:0:6487:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788748237.993680:0:6487:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788748237.993682:0:6487:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788748237.993901:0:6487:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000002523fd5 00000080:02000400:3.0:1788748237.993911:0:6487:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788748238.002479:0:6487:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788748238.002490:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788748238.002520:0:6487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a326824c) 00000020:00000080:3.0:1788748238.002537:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0F:1788748238.062797:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788748238.062981:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788748238.106106:0:6487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788748238.106368:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788748238.106376:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788748238.106388:0:6487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19a63 00000020:01000004:1.0:1788748238.106395:0:6487:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788748238.106400:0:6487:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788748238.106405:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000002523fd5 from MGS 00000020:01000004:1.0:1788748238.106410:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788748238.106429:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008ca77ae6) 00000020:00000080:1.0:1788748238.106441:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788748238.106518:0:6487:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000002523fd5 from MGS, refs=2 00080000:01000000:1.0:1788748238.106523:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788748238.106528:0:6487:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19a71 00000100:00100000:1.0:1788748238.106625:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788748238.106756:0:6487:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788748238.106763:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788748238.108231:0:6487:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788748238.108241:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788748238.109032:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748238.109223:0:6487:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788748238.109229:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788748238.116959:0:6487:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788748238.116972:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788748238.118167:0:6487:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788748238.118178:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788748238.123667:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748238.123674:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748238.123675:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748238.124438:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748238.124441:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748238.124443:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748238.124931:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788748238.135585:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788748238.374401:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4455 MB/s 00000001:01000000:3.0:1788748238.626358:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3730 MB/s 00000001:01000000:2.0:1788748238.877503:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 828 MB/s 00000001:01000000:2.0:1788748239.127412:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1239 MB/s 00080000:10000000:2.0:1788748239.131080:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788748239.137049:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788748239.137699:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788748239.137731:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788748239.137760:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788748239.137901:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788748239.137924:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788748239.138242:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748239.138543:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788748239.138550:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788748239.139039:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788748239.139045:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788748239.139365:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788748239.139370:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:0.0:1788748239.141102:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788748239.142352:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788748239.142374:0:6487:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:2.0:1788748239.142375:0:6487:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788748239.142419:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:2.0:1788748239.142437:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (0000000095139242) 00000020:00000080:2.0:1788748239.142451:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788748239.142577:0:6487:0:(ldlm_lib.c:103:import_set_conn()) imp 0000000060d33709@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00000100:00080000:0.0:1788748239.142737:0:6506:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1788748239.143451:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:2.0:1788748239.143457:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788748239.144462:0:6507:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788748239.144905:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid 27ab3bfa-63dd-419e-978e-87fcee7a537d) 00000020:00000080:3.0:1788748239.144926:0:6487:0:(genops.c:1384:class_connect()) connect: client 27ab3bfa-63dd-419e-978e-87fcee7a537d, cookie 0x9ba0f20a02e19a7f 00000100:00080000:3.0:1788748239.144938:0:6487:0:(import.c:545:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748239.144944:0:6487:0:(import.c:666:import_select_connection()) MGC192.168.203.122@tcp: import 0000000060d33709 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748239.144988:0:6487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005828f23b x1875638388523136/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748239.145015:0:6487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS 00000020:01000004:3.0:1788748239.145036:0:6487:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788748239.145041:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788748239.145052:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000cc6eb0d2) 00000020:00000080:3.0:1788748239.145065:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788748239.145244:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005828f23b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388523136:0@lo:250: 00000100:00100000:0.0:1788748239.145533:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.145604:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388523136 00000100:00100000:0.0:1788748239.145725:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388523136 00000100:00100000:0.0:1788748239.145767:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748239.145773:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072d38ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1875638388523136:12345-0@lo:250: 00010000:00080000:0.0:1788748239.145798:0:6502:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 27ab3bfa-63dd-419e-978e-87fcee7a537d@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1788748239.145823:0:6502:0:(genops.c:1384:class_connect()) connect: client 27ab3bfa-63dd-419e-978e-87fcee7a537d, cookie 0x9ba0f20a02e19a8d 00000100:00080000:0.0:1788748239.146343:0:6502:0:(import.c:65:import_set_state_nolock()) 000000005c3eaf28 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748239.146411:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072d38ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:3634:x1875638388523136:12345-0@lo:250: Request processed in 637us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748239.146419:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748239.146477:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788748239.146485:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1788748239.146492:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788748239.146496:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788748239.146499:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000060d33709 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788748239.146502:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788748239.146516:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788748239.146521:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005828f23b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388523136:0@lo:250: 00000100:00100000:3.0:1788748239.151702:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748239.151860:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748239.151870:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788748239.152644:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748239.152653:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788748239.152986:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788748239.152991:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788748239.154153:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748239.154364:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788748239.154370:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788748239.154980:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788748239.154987:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788748239.177458:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748239.177667:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788748239.177674:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788748239.178768:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788748239.178778:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788748239.179567:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748239.179735:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788748239.179740:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788748239.180059:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748239.180066:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788748239.180682:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748239.180827:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788748239.180832:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788748239.181104:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748239.181110:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788748239.181720:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748239.181845:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788748239.181850:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788748239.182355:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748239.182361:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788748239.196309:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748239.196595:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788748239.196601:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788748239.197854:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748239.197866:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788748239.198696:0:6487:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788748239.198704:0:6487:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788748239.199753:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788748239.199776:0:6487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788748239.199782:0:6487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788748239.199865:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788748239.199962:0:6487:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788748239.199967:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788748239.199969:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748239.199970:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748239.199972:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748239.199973:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748239.199974:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748239.199975:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748239.199977:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748239.199978:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748239.199979:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748239.199981:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748239.199982:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748239.199984:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788748239.199986:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748239.199987:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748239.199988:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748239.199989:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748239.199990:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748239.199992:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748239.199992:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748239.199994:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748239.199995:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748239.199996:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748239.199997:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748239.199998:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748239.200140:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788748239.200157:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018a142bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523264:0@lo:253: 00000100:00100000:1.0:1788748239.200256:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.200339:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388523264 00000100:00100000:0.0:1788748239.200351:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388523264 00000100:00100000:1.0:1788748239.200355:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e3afd5ed going to sleep for 11 seconds 00000100:00100000:0.0:1788748239.200390:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748239.200396:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c9cd7e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6487:x1875638388523264:12345-0@lo:253: 20000000:01000000:0.0:1788748239.200436:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788748239.200438:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788748239.201632:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788748239.201711:0:6504:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788748239.201969:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748239.202994:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788748239.203202:0:6504:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788748239.203207:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788748239.203212:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788748239.203215:0:6504:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788748239.203227:0:6504:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788748239.203502:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748239.203710:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788748239.203723:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788748239.203739:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788748239.203752:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788748239.203766:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788748239.203816:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788748239.203823:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788748239.203833:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788748239.203838:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788748239.203848:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788748239.203853:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788748239.203864:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788748239.203875:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788748239.203898:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788748239.203903:0:6504:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788748239.203909:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748239.203966:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788748239.203972:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788748239.203980:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788748239.203987:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788748239.204000:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788748239.204006:0:6504:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788748239.204018:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788748239.204022:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788748239.204028:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788748239.204036:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788748239.204052:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788748239.204058:0:6504:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788748239.204070:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788748239.204074:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788748239.204080:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788748239.204087:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788748239.204123:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788748239.204138:0:6504:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788748239.204142:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788748239.205487:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788748239.205867:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788748239.205886:0:6504:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:1.0:1788748239.205888:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1788748239.205895:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788748239.205899:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788748239.205906:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788748239.205909:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1788748239.205916:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788748239.205920:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788748239.205926:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788748239.205934:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788748239.205952:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788748239.205954:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788748239.205957:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788748239.206002:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788748239.206004:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788748239.206298:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788748239.206639:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788748239.206662:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788748239.206675:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788748239.206685:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788748239.206687:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788748239.207015:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788748239.207193:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788748239.207214:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788748239.207229:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788748239.207241:0:6504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748239.207244:0:6504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788748239.207249:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788748239.207252:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788748239.207258:0:6504:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788748239.207264:0:6504:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788748239.207650:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788748239.207739:0:6504:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788748239.218548:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788748239.218596:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788748239.218613:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788748239.218640:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788748239.218664:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218683:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218693:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218699:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218705:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218712:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218717:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000981933ab already unused, calling callback (000000002d9bebd3) 00010000:00010000:0.0:1788748239.218720:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218727:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218739:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218764:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.218770:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19a94 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788748239.218802:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788748239.233185:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c9cd7e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6487:x1875638388523264:12345-0@lo:253: Request processed in 32768us (32909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748239.233210:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748239.233305:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018a142bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523264:0@lo:253: 10000000:01000000:3.0:1788748239.233458:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788748239.233461:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748239.233463:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748239.233465:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748239.233466:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788748239.233467:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748239.233468:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748239.233470:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748239.233471:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748239.233472:0:6487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788748239.233474:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748239.233475:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788748239.233495:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000002523fd5 from lustre-MDT0000 10000000:01000000:3.0:1788748239.233527:0:6487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788748239.233530:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788748239.233535:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8add9ea619c0 10000000:01000000:3.0:1788748239.233540:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748239.233619:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8add9ea619c0 from 1 10000000:01000000:3.0:1788748239.233623:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788748239.233670:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.233680:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.233689:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748239.233708:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523392:0@lo:101: 00000100:00100000:3.0:1788748239.233751:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748239.233836:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f512465 going to sleep for 11 seconds 00000100:00100000:0.0:1788748239.233947:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388523392 00000100:00100000:0.0:1788748239.233955:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388523392 00000100:00100000:0.0:1788748239.234098:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748239.234108:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a5195dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6487:x1875638388523392:12345-0@lo:101: 00010000:00010000:0.0:1788748239.234123:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748239.234137:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19a9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.234160:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 6 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.234168:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 6 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.234186:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000981933ab, rc 0) 00000100:00100000:0.0:1788748239.234230:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a5195dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:6487:x1875638388523392:12345-0@lo:101: Request processed in 123us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748239.234236:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748239.234299:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523392:0@lo:101: 00010000:00010000:3.0:1788748239.234311:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.234339:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748239.234410:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523520:0@lo:501: 00000100:00100000:3.0:1788748239.234437:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748239.234647:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f512465 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.234734:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388523520 00000100:00100000:2.0:1788748239.234738:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388523520 00000100:00100000:2.0:1788748239.234759:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748239.234765:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004145b813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:6487:x1875638388523520:12345-0@lo:501: 00000100:00100000:2.0:1788748239.234859:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004145b813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:6487:x1875638388523520:12345-0@lo:501: Request processed in 94us (422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748239.234880:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748239.235272:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523520:0@lo:501: 10000000:01000000:3.0:1788748239.235304:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788748239.235342:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.235351:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748239.235368:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adda7357000 10000000:01000000:3.0:1788748239.235372:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788748239.235377:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8adda7357000 10000000:01000000:3.0:1788748239.235379:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788748239.235382:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8adda7357000 from 1 10000000:01000000:3.0:1788748239.235384:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788748239.235406:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000064fbd6c1/0x9ba0f20a02e19aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.235414:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000064fbd6c1/0x9ba0f20a02e19aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.235421:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000064fbd6c1/0x9ba0f20a02e19aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748239.235434:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523648:0@lo:101: 00000100:00100000:3.0:1788748239.235465:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748239.235481:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f512465 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.235608:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388523648 00000100:00100000:2.0:1788748239.235613:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388523648 00000100:00100000:2.0:1788748239.235635:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748239.235641:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020587e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:6487:x1875638388523648:12345-0@lo:101: 00010000:00010000:2.0:1788748239.235651:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748239.235662:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc3141e6/0x9ba0f20a02e19ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19aa9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.235680:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc3141e6/0x9ba0f20a02e19ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19aa9 expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.235687:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc3141e6/0x9ba0f20a02e19ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19aa9 expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.235695:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc3141e6, rc 0) 00000100:00100000:2.0:1788748239.235723:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020587e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+7:6487:x1875638388523648:12345-0@lo:101: Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.235738:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748239.235855:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523648:0@lo:101: 00010000:00010000:3.0:1788748239.235875:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000064fbd6c1/0x9ba0f20a02e19aa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.235883:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000064fbd6c1/0x9ba0f20a02e19aa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748239.235893:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788748239.235904:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000064fbd6c1/0x9ba0f20a02e19aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.235926:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000064fbd6c1/0x9ba0f20a02e19aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748239.235932:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788748239.235935:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748239.235939:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8adda7357000 10000000:01000000:3.0:1788748239.235942:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788748239.235945:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788748239.235946:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788748239.235959:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.235964:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.235970:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748239.235981:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523776:0@lo:101: 00000100:00100000:3.0:1788748239.236005:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748239.236038:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f512465 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.236202:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388523776 00000100:00100000:2.0:1788748239.236207:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388523776 00000100:00100000:2.0:1788748239.236228:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748239.236233:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bac82475 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+7:6487:x1875638388523776:12345-0@lo:101: 00010000:00010000:2.0:1788748239.236241:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748239.236247:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19ab7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.236260:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 8 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.236268:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 8 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.236274:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b72a4cfe, rc 0) 00000100:00100000:2.0:1788748239.236312:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bac82475 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+8:6487:x1875638388523776:12345-0@lo:101: Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.236351:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748239.236433:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523776:0@lo:101: 00010000:00010000:3.0:1788748239.236443:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.236449:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748239.236500:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523904:0@lo:501: 00000100:00100000:3.0:1788748239.236523:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748239.236558:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f512465 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.236654:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388523904 00000100:00100000:2.0:1788748239.236659:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388523904 00000100:00100000:2.0:1788748239.236676:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748239.236680:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d9ab3d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+8:6487:x1875638388523904:12345-0@lo:501: 00000100:00100000:2.0:1788748239.236796:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d9ab3d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6487:x1875638388523904:12345-0@lo:501: Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.236803:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748239.236883:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388523904:0@lo:501: 00000100:00100000:3.0:1788748239.236907:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524032:0@lo:503: 00000100:00100000:3.0:1788748239.236965:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748239.236979:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f512465 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.237138:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524032 00000100:00100000:2.0:1788748239.237143:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524032 00000100:00100000:2.0:1788748239.237165:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748239.237170:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cac12348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6487:x1875638388524032:12345-0@lo:503: 00000100:00100000:2.0:1788748239.237258:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cac12348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6487:x1875638388524032:12345-0@lo:503: Request processed in 87us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.237264:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748239.237425:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524032:0@lo:503: 00000100:00100000:1.0:1788748239.238187:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008cff1807 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6532:1875638388524160:0@lo:502: 00000100:00100000:1.0:1788748239.238235:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748239.238307:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000001dc2d583 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.238421:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524160 00000100:00100000:2.0:1788748239.238426:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524160 00000100:00100000:2.0:1788748239.238489:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748239.238496:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc501678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6532:x1875638388524160:12345-0@lo:502: 00000100:00100000:2.0:1788748239.238591:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc501678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6532:x1875638388524160:12345-0@lo:502: Request processed in 96us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.238598:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748239.238659:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008cff1807 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6532:1875638388524160:0@lo:502: 00000020:01000000:1.0:1788748239.238679:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748239.238693:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748239.238695:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788748239.238700:0:6532:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788748239.238703:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748239.238715:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000029e6c167) 00000020:00000080:1.0:1788748239.238731:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788748239.238736:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788748239.238816:0:6532:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788748239.238824:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19acc 00000020:00000080:1.0:1788748239.239060:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788748239.239065:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748239.239068:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748239.239069:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788748239.239072:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748239.239075:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748239.239076:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788748239.239079:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748239.239085:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005d89ff0a) 00000020:00000080:1.0:1788748239.239094:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788748239.239097:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788748239.239099:0:6532:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788748239.239101:0:6532:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788748239.239107:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748239.239155:0:6532:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000002523fd5 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788748239.239166:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000039daac55) 00000020:00000080:1.0:1788748239.239191:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788748239.239261:0:6532:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788748239.239266:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e19ae1 00000020:00000080:1.0:1788748239.239368:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788748239.239375:0:6532:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788748239.239379:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9ba0f20a02e19ae8 00080000:01000000:1.0:1788748239.239383:0:6532:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788748239.239387:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19aef 00080000:10000000:1.0:1788748239.239765:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788748239.239907:0:6532:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788748239.244472:0:6532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788748239.305915:0:6532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788748239.306915:0:6532:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788748239.310969:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788748239.311927:0:6532:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788748239.319701:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007f18a986) 00000020:00000080:2.0:1788748239.319727:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788748239.319814:0:6532:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788748239.319821:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19afd 00000020:00000080:1.0:1788748239.325506:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788748239.327216:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788748239.330221:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788748239.336959:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788748239.342918:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788748239.347311:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788748239.350742:0:6532:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788748239.352752:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9ba0f20a02e19b04 00000020:00000080:0.0:1788748239.353367:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788748239.353379:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748239.353394:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748239.353397:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788748239.353400:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748239.353405:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748239.353406:0:6532:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748239.353409:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748239.353411:0:6532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788748239.353414:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748239.353416:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748239.353417:0:6532:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788748239.353419:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748239.353423:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748239.353425:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788748239.353429:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788748239.353464:0:6532:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788748239.353551:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072c50d25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6532:1875638388524288:0@lo:502: 00000100:00100000:0.0:1788748239.353622:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.353668:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d37957e going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.354165:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524288 00000100:00100000:2.0:1788748239.354187:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524288 00000100:00100000:2.0:1788748239.354235:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748239.354244:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6c3a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6532:x1875638388524288:12345-0@lo:502: 00000100:00100000:2.0:1788748239.354446:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6c3a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6532:x1875638388524288:12345-0@lo:502: Request processed in 203us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.354454:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748239.354674:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072c50d25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6532:1875638388524288:0@lo:502: 00000020:01000000:3.0:1788748239.354700:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748239.354705:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748239.354707:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788748239.354711:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788748239.354874:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788748239.354997:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788748239.355105:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.355126:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748239.355134:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adda7357000 from 1 10000000:01000000:2.0:1788748239.355136:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748239.355168:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.355191:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.355199:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748239.355213:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000572fbc6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524416:0@lo:101: 00000100:00100000:2.0:1788748239.355247:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748239.355311:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063335da0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748239.358591:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524416 00000100:00100000:3.0:1788748239.358606:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524416 00000100:00100000:3.0:1788748239.358661:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748239.358670:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000415cefe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:6487:x1875638388524416:12345-0@lo:101: 00010000:00010000:3.0:1788748239.358689:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748239.358709:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b0b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.358735:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.358744:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.358765:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048670002, rc 0) 00000100:00100000:3.0:1788748239.358836:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000415cefe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:6487:x1875638388524416:12345-0@lo:101: Request processed in 169us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748239.358843:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748239.359003:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000572fbc6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524416:0@lo:101: 00010000:00010000:0.0:1788748239.359029:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.359038:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748239.359604:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524544:0@lo:256: 00000100:00100000:0.0:1788748239.360623:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.360760:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038c82072 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.362721:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524544 00000100:00100000:2.0:1788748239.362734:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524544 00000100:00100000:2.0:1788748239.362845:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748239.362854:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b91304d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:6487:x1875638388524544:12345-0@lo:256: 20000000:01000000:2.0:1788748239.362892:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788748239.362906:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788748239.363192:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b91304d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:6487:x1875638388524544:12345-0@lo:256: Request processed in 338us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.363200:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748239.364505:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524544:0@lo:256: 10000000:01000000:0.0:1788748239.366847:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748239.366990:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.367005:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748239.367069:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adda7357000 from 1 10000000:01000000:0.0:1788748239.367073:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748239.367118:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.367126:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.367134:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748239.367156:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524672:0@lo:101: 00000100:00100000:0.0:1788748239.367230:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.367413:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038c82072 going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.367617:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524672 00000100:00100000:2.0:1788748239.367626:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524672 00000100:00100000:3.0:1788748239.367742:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748239.367751:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007fba33b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:6487:x1875638388524672:12345-0@lo:101: 00010000:00010000:3.0:1788748239.367765:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748239.367777:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b19 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.367800:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.367811:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.367817:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035fdaf4e, rc 0) 00000100:00100000:3.0:1788748239.367858:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007fba33b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6487:x1875638388524672:12345-0@lo:101: Request processed in 109us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748239.367876:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748239.368698:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524672:0@lo:101: 00010000:00010000:0.0:1788748239.368718:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.368728:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748239.368808:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524800:0@lo:501: 00000100:00100000:0.0:1788748239.368840:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.368880:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038c82072 going to sleep for 11 seconds 00000100:00100000:3.0:1788748239.368968:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524800 00000100:00100000:3.0:1788748239.368973:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524800 00000100:00100000:3.0:1788748239.369007:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748239.369024:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008b82a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6487:x1875638388524800:12345-0@lo:501: 00000100:00100000:3.0:1788748239.369213:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008b82a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6487:x1875638388524800:12345-0@lo:501: Request processed in 200us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748239.369222:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748239.369697:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524800:0@lo:501: 00000100:00100000:0.0:1788748239.369727:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524928:0@lo:503: 00000100:00100000:0.0:1788748239.369762:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.369791:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038c82072 going to sleep for 11 seconds 00000100:00100000:3.0:1788748239.369830:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388524928 00000100:00100000:3.0:1788748239.369834:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388524928 00000100:00100000:3.0:1788748239.369867:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748239.369872:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004e8f2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6487:x1875638388524928:12345-0@lo:503: 00000040:00080000:3.0:1788748239.369992:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748239.370046:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004e8f2c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6487:x1875638388524928:12345-0@lo:503: Request processed in 168us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748239.370053:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748239.370202:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388524928:0@lo:503: 00000040:00080000:2.0:1788748239.372237:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788748239.372913:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788748239.372935:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748239.372950:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.372962:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748239.373009:0:6487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788748239.373012:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adda7357000 10000000:01000000:0.0:1788748239.373023:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adda7357000 10000000:01000000:0.0:1788748239.373027:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748239.373032:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adda7357000 from 1 10000000:01000000:0.0:1788748239.373035:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748239.373073:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.373081:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.373103:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748239.373123:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525056:0@lo:101: 00000100:00100000:0.0:1788748239.373190:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.373237:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d37957e going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.374719:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525056 00000100:00100000:2.0:1788748239.374732:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525056 00000100:00100000:2.0:1788748239.374795:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748239.374804:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afbf8f89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6487:x1875638388525056:12345-0@lo:101: 00010000:00010000:2.0:1788748239.374821:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748239.374836:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b27 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.374861:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.374869:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.374878:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039acb440, rc 0) 00000100:00100000:2.0:1788748239.374945:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afbf8f89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6487:x1875638388525056:12345-0@lo:101: Request processed in 142us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.374951:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748239.375639:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525056:0@lo:101: 00010000:00010000:0.0:1788748239.375664:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.375673:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748239.375761:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525184:0@lo:501: 00000100:00100000:0.0:1788748239.375799:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.375839:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d37957e going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.375909:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525184 00000100:00100000:2.0:1788748239.375915:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525184 00000100:00100000:2.0:1788748239.375949:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788748239.375956:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008038661e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6487:x1875638388525184:12345-0@lo:501: 00000100:00100000:2.0:1788748239.376097:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008038661e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6487:x1875638388525184:12345-0@lo:501: Request processed in 141us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.376105:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748239.376525:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525184:0@lo:501: 00000100:00100000:0.0:1788748239.376556:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525312:0@lo:503: 00000100:00100000:0.0:1788748239.376604:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.376629:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d37957e going to sleep for 11 seconds 00000100:00100000:1.0:1788748239.376701:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525312 00000100:00100000:1.0:1788748239.376706:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525312 00000100:00100000:1.0:1788748239.376736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748239.376743:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d51d5d67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6487:x1875638388525312:12345-0@lo:503: 00000100:00100000:1.0:1788748239.376825:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d51d5d67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6487:x1875638388525312:12345-0@lo:503: Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748239.376832:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748239.377022:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525312:0@lo:503: 00000100:00100000:0.0:1788748239.377681:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6537:1875638388525440:0@lo:502: 00000100:00100000:0.0:1788748239.377719:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.377751:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c40231c2 going to sleep for 11 seconds 00000100:00100000:3.0:1788748239.377795:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525440 00000100:00100000:3.0:1788748239.377801:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525440 00000100:00100000:3.0:1788748239.377838:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788748239.377846:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ef8b2c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6537:x1875638388525440:12345-0@lo:502: 00000100:00100000:3.0:1788748239.377959:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ef8b2c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6537:x1875638388525440:12345-0@lo:502: Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748239.377966:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748239.378169:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6537:1875638388525440:0@lo:502: 00000020:01000004:0.0:1788748239.378248:0:6537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788748239.378272:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000056daf4cc) 00000020:00000080:0.0:1788748239.378291:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788748239.378409:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000002523fd5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788748239.378413:0:6537:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000002523fd5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788748239.378415:0:6537:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000002523fd5 4 00010000:00080000:0.0:1788748239.378442:0:6537:0:(ldlm_lib.c:103:import_set_conn()) imp 000000003a2a2df8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1788748239.380065:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788748239.380291:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788748239.380347:0:6537:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788748239.380359:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9ba0f20a02e19b3c 00000100:00080000:0.0:1788748239.380368:0:6537:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748239.380376:0:6537:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a2a2df8 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748239.380409:0:6537:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d57ff8b6 x1875638388525568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748239.380435:0:6537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788748239.381856:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388525568:0@lo:38: 00000100:00100000:2.0:1788748239.381950:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748239.385129:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b4f3436 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6537:1875638388525696:0@lo:502: 00000100:00100000:2.0:1788748239.385221:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748239.385271:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525696 00000100:00100000:2.0:1788748239.385278:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525696 00000100:00100000:2.0:1788748239.385372:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748239.385379:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000193f835f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6537:x1875638388525696:12345-0@lo:502: 00000100:00100000:2.0:1788748239.385490:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000193f835f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6537:x1875638388525696:12345-0@lo:502: Request processed in 112us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.385498:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748239.385545:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a71355f going to sleep for 11 seconds 00000100:00100000:2.0:1788748239.385565:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b4f3436 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:6537:1875638388525696:0@lo:502: 00000040:00080000:2.0:1788748239.385588:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788748239.385824:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788748239.385850:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748239.385864:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748239.385876:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788748239.385932:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788748239.385935:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748239.385936:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748239.385937:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748239.385938:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748239.385940:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748239.385941:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748239.385947:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748239.385948:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748239.385949:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748239.385951:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748239.385952:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748239.385955:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788748239.385957:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748239.385959:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748239.385959:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748239.385960:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748239.385961:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748239.385962:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748239.385963:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748239.385963:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748239.385964:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748239.385965:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748239.385966:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748239.385967:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748239.385980:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788748239.385989:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008cff1807 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525824:0@lo:253: 00000100:00100000:1.0:1788748239.386035:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748239.386054:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000007a6b4dc3 going to sleep for 11 seconds 00000100:00100000:1.0:1788748239.386070:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525824 00000100:00100000:1.0:1788748239.386074:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525824 00000100:00100000:1.0:1788748239.386097:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788748239.386103:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000068c87e3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6487:x1875638388525824:12345-0@lo:253: 20000000:01000000:1.0:1788748239.386122:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788748239.386133:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788748239.388785:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525568 00000100:00100000:0.0:1788748239.388798:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525568 00000100:00100000:0.0:1788748239.388841:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748239.388848:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9b8cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875638388525568:12345-0@lo:38: 00000100:00100000:0.0:1788748239.388944:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9b8cd31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875638388525568:12345-0@lo:38: Request processed in 95us (6993us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788748239.388951:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748239.388995:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748239.389003:0:3634:0:(import.c:65:import_set_state_nolock()) 000000003a2a2df8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748239.389007:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788748239.389010:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388525568:0@lo:38: 20000000:01000000:1.0:1788748239.394768:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788748239.394785:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788748239.395025:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788748239.395031:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788748239.395056:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.395074:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.395081:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.395120:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748239.395137:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 12 pid: 6502 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748239.395150:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388525952:0@lo:104: 00000100:00100000:0.0:1788748239.395220:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748239.395281:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 000000005951a731 going to sleep for 11 seconds 00000100:00100000:1.0:1788748239.395286:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388525952 00000100:00100000:1.0:1788748239.395296:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388525952 00000100:00100000:1.0:1788748239.395361:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748239.395369:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d10563e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388525952:12345-0@lo:104: 00010000:00010000:1.0:1788748239.395383:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748239.395470:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748239.395477:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d10563e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388525952:12345-0@lo:104: Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748239.395484:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748239.395491:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d57ff8b6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388525952:0@lo:104: 00010000:00010000:3.0:1788748239.395512:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395556:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748239.395562:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395569:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000082b9627 already unused, calling callback (000000006e8bf550) 10000000:00010000:2.0:1788748239.395572:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395579:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748239.395585:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748239.395589:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748239.395623:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395640:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748239.395660:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395666:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000082b9627/0x9ba0f20a02e19b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b12 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395681:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748239.395683:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748239.395685:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748239.395746:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b4f3436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388526080:0@lo:103: 00000100:00100000:1.0:1788748239.395779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748239.395908:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526080 00000100:00100000:2.0:1788748239.395913:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526080 00010000:00010000:2.0:1788748239.395930:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 13 pid: 6502 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748239.395954:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748239.395959:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000494033d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:3636:x1875638388526080:12345-0@lo:103: 00010000:00010000:2.0:1788748239.395968:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748239.395971:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 13 pid: 6502 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395979:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 13 pid: 6502 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.395990:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000048670002/0x9ba0f20a02e19b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19b0b expref: 13 pid: 6502 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396000:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396015:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748239.396027:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000997432s 00010000:00010000:2.0:1788748239.396031:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396036:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396570:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396576:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396581:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e2731a12 already unused, calling callback (000000002d9bebd3) 00010000:00010000:2.0:1788748239.396584:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396589:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396607:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748239.396616:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748239.396662:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000494033d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3636:x1875638388526080:12345-0@lo:103: Request processed in 703us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.396669:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788748239.396722:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.396730:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748239.396735:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748239.397080:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b4f3436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388526080:0@lo:103: 00000100:00100000:2.0:1788748239.397763:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000068c87e3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6487:x1875638388525824:12345-0@lo:253: Request processed in 11659us (11726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748239.397772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788748239.397888:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008cff1807 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:6487:1875638388525824:0@lo:253: 10000000:01000000:1.0:1788748239.397907:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788748239.397909:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788748239.397912:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788748239.397913:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748239.397914:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748239.397915:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748239.397916:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748239.397917:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788748239.397918:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788748239.397919:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748239.397920:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748239.397922:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748239.397923:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788748239.397932:0:6487:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788748239.413748:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788748239.413995:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788748239.414272:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788748239.414467:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788748239.414642:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788748239.414809:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788748239.417526:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788748239.417687:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788748239.417847:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788748239.417985:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788748239.418287:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788748239.418736:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788748239.421856:0:6487:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788748239.434462:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788748239.434521:0:6542:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788748239.434525:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788748239.434787:0:6543:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788748239.445837:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788748239.448505:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748239.450025:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788748239.451395:0:6487:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788748239.451415:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788748239.451645:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748239.453642:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788748239.456636:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788748239.456714:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788748239.456953:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788748239.459525:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1788748239.462017:0:6543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788748239.462480:0:6543:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788748239.462492:0:6543:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788748239.463136:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788748239.464819:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788748239.465586:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788748239.465729:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788748239.465860:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788748239.468443:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788748239.468613:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788748239.468759:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788748239.470483:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788748239.470697:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788748239.470879:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788748239.471057:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788748239.471210:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788748239.474492:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788748239.474757:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788748239.474907:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788748239.475215:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788748239.475410:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788748239.475564:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788748239.475700:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788748239.475830:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788748239.475978:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788748239.476103:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788748239.477080:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788748239.477277:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788748239.478147:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788748239.478780:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788748239.479009:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788748239.479150:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788748239.479434:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788748239.479571:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788748239.479711:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788748239.480027:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788748239.492076:0:6487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788748239.492116:0:6487:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf7081cc7988 00100000:10000000:2.0:1788748239.492124:0:6487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788748239.492904:0:6487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788748239.492923:0:6487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788748239.492940:0:6487:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788748239.492956:0:6487:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788748239.493713:0:6487:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748239.493893:0:6487:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788748240.164607:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748241.189459:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748242.220483:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748243.236711:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748244.261405:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748244.445471:0:6788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788748244.772968:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788748244.772984:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788748244.772988:0:38:0:(import.c:65:import_set_state_nolock()) 000000003a2a2df8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748244.773020:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a2a2df8 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748244.773058:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b6b3e333 x1875638388526336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748244.773224:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748244.773247:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da046a05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388526208:0@lo:400: 00000100:00100000:0.0:1788748244.773363:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6b3e333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388526336:0@lo:38: 00000100:00100000:0.0:1788748244.773485:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748244.774731:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748244.775477:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526208 00000100:00100000:0.0:1788748244.775491:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526208 00000100:00100000:0.0:1788748244.775561:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748244.775571:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d4bf4b95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:3638:x1875638388526208:12345-0@lo:400: 00000100:00100000:0.0:1788748244.775704:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d4bf4b95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:3638:x1875638388526208:12345-0@lo:400: Request processed in 134us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748244.775712:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748244.776035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526336 00000100:00100000:2.0:1788748244.776042:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526336 00000100:00100000:1.0:1788748244.776050:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da046a05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388526208:0@lo:400: 00000100:00100000:2.0:1788748244.776078:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748244.776083:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000097c69d05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875638388526336:12345-0@lo:38: 00010000:00080000:2.0:1788748244.776118:0:6512:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1788748244.776182:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9ba0f20a02e19b4a 00000004:00100000:2.0:1788748244.776253:0:6512:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788748244.778072:0:6512:0:(import.c:65:import_set_state_nolock()) 0000000063c35134 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748244.778237:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000097c69d05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875638388526336:12345-0@lo:38: Request processed in 2151us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748244.778250:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788748244.778341:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b6b3e333 x1875638388526336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748244.778367:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788748244.778379:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788748244.778387:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788748244.778390:0:3634:0:(import.c:65:import_set_state_nolock()) 000000003a2a2df8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788748244.778398:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6b3e333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388526336:0@lo:38: 00010000:00010000:2.0:1788748245.284645:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788748245.287445:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788748245.287456:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adda7357000 from 3 10000000:01000000:2.0:1788748245.287462:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748245.287518:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748245.287533:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748245.287559:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748245.287588:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ed2a40b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388526464:0@lo:101: 00000100:00100000:2.0:1788748245.287679:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748245.287740:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000129634e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788748245.288326:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526464 00000100:00100000:1.0:1788748245.288338:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526464 00000100:00100000:1.0:1788748245.288417:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788748245.288426:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a636abbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:6507:x1875638388526464:12345-0@lo:101: 00010000:00010000:1.0:1788748245.288443:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748245.288473:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b51 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748245.288504:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748245.288516:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748245.288526:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000831af9ff, rc 0) 00000100:00100000:1.0:1788748245.288582:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a636abbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6507:x1875638388526464:12345-0@lo:101: Request processed in 158us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748245.288590:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748245.288939:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ed2a40b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388526464:0@lo:101: 00010000:00010000:2.0:1788748245.288956:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748245.288966:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748245.289027:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ed2a40b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388526592:0@lo:256: 00000100:00100000:2.0:1788748245.289067:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748245.289110:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000129634e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788748245.289164:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526592 00000100:00100000:1.0:1788748245.289170:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526592 00000100:00100000:1.0:1788748245.289202:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788748245.289208:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a785560b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6507:x1875638388526592:12345-0@lo:256: 20000000:01000000:1.0:1788748245.289224:0:6503:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788748245.289241:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788748245.289244:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788748245.289336:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a785560b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:6507:x1875638388526592:12345-0@lo:256: Request processed in 128us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748245.289344:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748245.289938:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ed2a40b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388526592:0@lo:256: 10000000:01000000:2.0:1788748245.289988:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788748245.289995:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748245.290006:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788748245.441903:0:6840:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748245.442155:0:6840:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788748246.308620:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748247.332592:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788748248.091880:0:6941:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748248.092062:0:6941:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748248.357793:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748249.380444:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748249.892713:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001177d0ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388526848:0@lo:400: 00000100:00100000:1.0:1788748249.892713:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a186cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388526720:0@lo:400: 00000100:00100000:2.0:1788748249.895723:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748249.895826:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748249.895898:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526720 00000100:00100000:3.0:1788748249.895908:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526720 00000100:00100000:3.0:1788748249.895965:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788748249.895974:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a05b257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3638:x1875638388526720:12345-0@lo:400: 00000100:00100000:3.0:1788748249.896041:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a05b257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3638:x1875638388526720:12345-0@lo:400: Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748249.896049:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748249.896197:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a186cc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388526720:0@lo:400: 00000100:00100000:0.0:1788748249.896657:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526848 00000100:00100000:0.0:1788748249.896664:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526848 00000100:00100000:0.0:1788748249.896741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748249.896748:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ed2a40b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388526848:12345-0@lo:400: 00000100:00100000:0.0:1788748249.896809:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ed2a40b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388526848:12345-0@lo:400: Request processed in 61us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748249.896815:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788748249.896880:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001177d0ca x1875638388526848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748249.896893:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001177d0ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388526848:0@lo:400: 00010000:00010000:1.0:1788748250.404496:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748251.429550:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748252.454637:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748253.478025:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748254.500713:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748255.012678:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748255.013310:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748255.013358:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b226b68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388527104:0@lo:400: 00000100:00100000:1.0:1788748255.013431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748255.013737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388527104 00000100:00100000:0.0:1788748255.013768:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388527104 00000100:00100000:0.0:1788748255.013824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748255.013833:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008cff1807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388527104:12345-0@lo:400: 00000100:00100000:0.0:1788748255.013899:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008cff1807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388527104:12345-0@lo:400: Request processed in 68us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748255.013907:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788748255.014107:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009b226b68 x1875638388527104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748255.014121:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b226b68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388527104:0@lo:400: 00000100:00100000:3.0:1788748255.026268:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9bb61f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388526976:0@lo:400: 00000100:00100000:3.0:1788748255.026376:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748255.026689:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388526976 00000100:00100000:2.0:1788748255.026699:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388526976 00000100:00100000:2.0:1788748255.026917:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748255.026936:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071685714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3635:x1875638388526976:12345-0@lo:400: 00000100:00100000:2.0:1788748255.027015:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071685714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3635:x1875638388526976:12345-0@lo:400: Request processed in 82us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748255.027087:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9bb61f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388526976:0@lo:400: 00000100:00100000:2.0:1788748255.030096:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788748255.524872:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748256.553727:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748257.572910:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748257.850975:0:7440:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788748257.850981:0:7440:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788748257.850983:0:7440:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788748257.851156:0:7440:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000eb8085c5 00000020:01000004:2.0:1788748257.851181:0:7440:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788748257.851196:0:7440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788748257.851215:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000da9748f7) 00000020:00000080:2.0:1788748257.851238:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788748257.901823:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788748257.901933:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788748257.919062:0:7440:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788748257.919302:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788748257.919313:0:7440:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788748257.919358:0:7440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e19b66 00000020:01000004:3.0:1788748257.919364:0:7440:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788748257.919390:0:7440:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788748257.919393:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788748257.919399:0:7440:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788748257.919542:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788748257.919548:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788748257.948295:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788748257.948357:0:7440:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788748257.948365:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788748257.948367:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788748257.948368:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748257.948369:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748257.948370:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748257.948371:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748257.948372:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748257.948373:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748257.948374:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748257.948376:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748257.948378:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748257.948381:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788748257.948384:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748257.948385:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788748257.948385:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748257.948386:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748257.948387:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748257.948388:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748257.948388:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748257.948389:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748257.948390:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748257.948390:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748257.948391:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788748257.948415:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788748257.948430:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388527232:0@lo:253: 00000100:00100000:2.0:1788748257.948506:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748257.948560:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 0000000002b07ce3 going to sleep for 11 seconds 00000100:00100000:1.0:1788748257.948816:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388527232 00000100:00100000:1.0:1788748257.948825:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388527232 00000100:00100000:1.0:1788748257.948882:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748257.948890:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002860a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388527232:12345-0@lo:253: 20000000:01000000:1.0:1788748257.948921:0:6503:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788748257.948925:0:6503:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788748257.948930:0:6503:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788748257.948933:0:6503:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788748257.948967:0:6503:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788748257.949173:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748257.949312:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788748257.952017:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788748257.952506:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788748257.952559:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788748257.952579:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788748257.952667:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788748257.952676:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788748257.952689:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788748257.952695:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788748257.952706:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788748257.952711:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788748257.952722:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788748257.953564:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788748257.953704:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788748257.953714:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1788748257.953728:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788748257.953734:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788748257.954804:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788748257.954826:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1788748257.954847:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788748257.954854:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788748257.954866:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788748257.954883:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788748257.954899:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788748257.955006:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788748257.955017:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788748257.955030:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788748257.955078:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788748257.955099:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788748257.955106:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788748257.955118:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788748257.955138:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788748257.955144:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788748257.958097:0:6503:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788748257.958112:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788748257.959427:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788748257.960038:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788748257.960077:0:6503:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:3.0:1788748257.960080:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:3.0:1788748257.960098:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788748257.960105:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788748257.960117:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788748257.960122:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:3.0:1788748257.960137:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788748257.960144:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788748257.960157:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788748257.960173:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788748257.960236:0:6503:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788748257.960246:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788748257.966610:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788748257.974792:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788748257.974828:0:6503:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:0.0:1788748257.974830:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:0.0:1788748257.974847:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788748257.974854:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788748257.974867:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788748257.974874:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:0.0:1788748257.974887:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788748257.974894:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788748257.974906:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788748257.974919:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788748257.974946:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788748257.974963:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788748257.974967:0:6503:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788748257.975018:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788748257.975021:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788748257.979204:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788748257.979253:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788748257.979270:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788748257.979460:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788748257.979484:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788748257.979499:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788748257.979510:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788748257.979512:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788748257.979957:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788748257.979973:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788748257.979981:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788748257.980119:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788748257.980139:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788748257.980156:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788748257.980166:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788748257.980168:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788748257.982717:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788748257.982885:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788748257.982903:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788748257.983131:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788748257.983158:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788748257.983189:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788748257.983206:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788748257.983208:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788748257.983212:0:6503:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788748257.983219:0:6503:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788748257.984569:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788748257.984756:0:6503:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788748257.997020:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788748257.997059:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997081:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997089:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997114:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997120:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997162:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997177:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 12 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748257.997194:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d9bb61f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388527360:0@lo:104: 00000100:00100000:0.0:1788748257.997260:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748257.997357:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997365:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 12 pid: 6502 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748257.997373:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db4f2947 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388527488:0@lo:104: 00000100:00100000:0.0:1788748257.997396:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748257.997708:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748257.997718:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 12 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748257.997727:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa1656e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388527616:0@lo:104: 00000100:00100000:0.0:1788748257.997772:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748257.998448:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set 000000002965e63e going to sleep for 11 seconds 00000100:00100000:1.0:1788748257.998527:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388527360 00000100:00100000:1.0:1788748257.998536:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388527360 00000100:00100000:1.0:1788748257.998570:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388527488 00000100:00100000:1.0:1788748257.998572:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388527488 00000100:00100000:1.0:1788748257.998580:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388527616 00000100:00100000:1.0:1788748257.998581:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388527616 00000100:00100000:1.0:1788748257.998592:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748257.998598:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b226b68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6503:x1875638388527360:12345-0@lo:104: 00010000:00010000:1.0:1788748257.998610:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748257.998815:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748257.998821:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b226b68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6503:x1875638388527360:12345-0@lo:104: Request processed in 223us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748257.998828:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748257.998846:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748257.998851:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d1fdfc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6503:x1875638388527488:12345-0@lo:104: 00010000:00010000:1.0:1788748257.998858:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748257.998890:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748257.998894:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d1fdfc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6503:x1875638388527488:12345-0@lo:104: Request processed in 44us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748257.998900:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748257.998911:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748257.998916:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afa3a038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388527616:12345-0@lo:104: 00010000:00010000:1.0:1788748257.998921:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748257.998944:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788748257.998947:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afa3a038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388527616:12345-0@lo:104: Request processed in 33us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748257.998952:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788748257.999006:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788748257.999012:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999028:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ab7ec9e already unused, calling callback (000000006e8bf550) 10000000:00010000:3.0:1788748257.999031:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999038:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748257.999044:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748257.999059:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748257.999099:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999106:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748257.999123:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999128:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b2e expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999142:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748257.999144:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999150:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ac2dfd5a already unused, calling callback (000000006e8bf550) 10000000:00010000:3.0:1788748257.999152:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999166:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748257.999172:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748257.999176:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748257.999189:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999194:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748257.999207:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999212:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000ac2dfd5a/0x9ba0f20a02e19ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19abe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999221:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748257.999223:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999227:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cde20e7c already unused, calling callback (000000006e8bf550) 10000000:00010000:3.0:1788748257.999229:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999234:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748257.999239:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748257.999251:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748257.999265:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999270:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748257.999275:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999280:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19aa2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999291:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748257.999292:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748257.999294:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748257.999302:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748257.999331:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388527744:0@lo:103: 00000100:00100000:3.0:1788748257.999365:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748257.999394:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4f9e3f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388528000:0@lo:103: 00000100:00100000:3.0:1788748257.999414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748257.999432:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748257.999437:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc2c18ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388527872:0@lo:103: 00000100:00100000:3.0:1788748257.999456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748257.999482:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388527744 00000100:00100000:3.0:1788748257.999488:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388527744 00010000:00010000:3.0:1788748257.999506:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 13 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748257.999520:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528000 00000100:00100000:3.0:1788748257.999529:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528000 00010000:00010000:3.0:1788748257.999540:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 14 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748257.999551:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388527872 00000100:00100000:3.0:1788748257.999554:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388527872 00010000:00010000:3.0:1788748257.999574:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 15 pid: 6502 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748257.999595:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748257.999601:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d40ce6d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3637:x1875638388527744:12345-0@lo:103: 00010000:00010000:3.0:1788748257.999612:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748257.999616:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 15 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999623:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 15 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999794:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748257.999828:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d40ce6d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3637:x1875638388527744:12345-0@lo:103: Request processed in 228us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748257.999834:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748257.999850:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748257.999855:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b926474d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:3636:x1875638388528000:12345-0@lo:103: 00010000:00010000:3.0:1788748257.999863:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748257.999866:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 14 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999874:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 14 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999892:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748257.999918:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b926474d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:3636:x1875638388528000:12345-0@lo:103: Request processed in 64us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748257.999924:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748257.999935:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748257.999941:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ed780e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:3636:x1875638388527872:12345-0@lo:103: 00010000:00010000:3.0:1788748257.999949:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748257.999952:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 13 pid: 6502 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999960:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 13 pid: 6502 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999970:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999977:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999990:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748257.999996:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.000001:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.000006:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.000016:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002be2698c already unused, calling callback (000000002d9bebd3) 00010000:00010000:3.0:1788748258.000019:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.000024:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.000031:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.000040:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748258.000074:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ed780e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:3636:x1875638388527872:12345-0@lo:103: Request processed in 134us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.000080:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748258.000120:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388527744:0@lo:103: 00000100:00100000:3.0:1788748258.000142:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc2c18ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388527872:0@lo:103: 00000100:00100000:3.0:1788748258.000148:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4f9e3f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388528000:0@lo:103: 00010000:00010000:2.0:1788748258.000530:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748258.000615:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000039acb440/0x9ba0f20a02e19b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19b27 expref: 12 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.000630:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d9bb61f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388527360:0@lo:104: 00010000:00010000:1.0:1788748258.000767:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b72a4cfe/0x9ba0f20a02e19abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19ab7 expref: 11 pid: 6502 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748258.000778:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db4f2947 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388527488:0@lo:104: 00010000:00010000:1.0:1788748258.000799:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000981933ab/0x9ba0f20a02e19aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19a9b expref: 10 pid: 6503 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748258.000809:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa1656e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388527616:0@lo:104: 00010000:00010000:1.0:1788748258.000829:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.000836:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.000841:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.000846:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002be2698c/0x9ba0f20a02e19b6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788748258.000860:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788748258.002765:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002860a251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:7440:x1875638388527232:12345-0@lo:253: Request processed in 53871us (54254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.002778:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748258.002867:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388527232:0@lo:253: 10000000:01000000:2.0:1788748258.002882:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788748258.002885:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748258.002887:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788748258.002888:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748258.002890:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788748258.002891:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748258.002902:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748258.002903:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748258.002905:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788748258.002907:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748258.002908:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788748258.002926:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eb8085c5 from lustre-MDT0001 10000000:01000000:2.0:1788748258.002956:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788748258.002959:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788748258.002965:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8add9ea619c0 local copy 10000000:01000000:2.0:1788748258.002969:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788748258.003002:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748258.003012:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748258.003021:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748258.003038:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528128:0@lo:101: 00000100:00100000:2.0:1788748258.003084:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748258.003122:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004ec0777 going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.003217:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528128 00000100:00100000:1.0:1788748258.003224:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528128 00000100:00100000:1.0:1788748258.003270:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748258.003279:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000edd5f24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+9:7440:x1875638388528128:12345-0@lo:101: 00010000:00010000:1.0:1788748258.003291:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748258.003303:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b87f690c/0x9ba0f20a02e19b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b74 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.003359:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b87f690c/0x9ba0f20a02e19b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b74 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.003382:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b87f690c/0x9ba0f20a02e19b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b74 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.003390:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b87f690c, rc 0) 00000100:00100000:1.0:1788748258.003525:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000edd5f24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:7440:x1875638388528128:12345-0@lo:101: Request processed in 247us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.003532:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748258.003600:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528128:0@lo:101: 00010000:00010000:2.0:1788748258.003612:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748258.003620:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748258.003714:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528256:0@lo:501: 00000100:00100000:2.0:1788748258.003750:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748258.003782:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004ec0777 going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.003907:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528256 00000100:00100000:1.0:1788748258.003913:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528256 00000100:00100000:1.0:1788748258.003943:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788748258.003949:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000600a5f3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:7440:x1875638388528256:12345-0@lo:501: 00000100:00100000:1.0:1788748258.004013:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000600a5f3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:7440:x1875638388528256:12345-0@lo:501: Request processed in 64us (262us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788748258.004019:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748258.004083:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528256:0@lo:501: 10000000:01000000:0.0:1788748258.004096:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788748258.004115:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788748258.004119:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004132:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004138:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004166:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788748258.004190:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8add8f106000 10000000:01000000:0.0:1788748258.004194:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788748258.004198:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8add9ea619c0 10000000:01000000:0.0:1788748258.004200:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788748258.004203:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8add9ea619c0 from 1 10000000:01000000:0.0:1788748258.004206:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788748258.004221:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000a655f860/0x9ba0f20a02e19b82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004232:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000a655f860/0x9ba0f20a02e19b82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004248:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000a655f860/0x9ba0f20a02e19b82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.004260:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528384:0@lo:101: 00000100:00100000:0.0:1788748258.004286:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.004310:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000837832b1 going to sleep for 11 seconds 00000100:00100000:0.0:1788748258.004347:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528384 00000100:00100000:0.0:1788748258.004350:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528384 00000100:00100000:0.0:1788748258.004367:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748258.004372:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000e271e7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+10:7440:x1875638388528384:12345-0@lo:101: 00010000:00010000:0.0:1788748258.004379:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748258.004386:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b42877d5/0x9ba0f20a02e19b89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b82 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004401:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b42877d5/0x9ba0f20a02e19b89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b82 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004480:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b42877d5/0x9ba0f20a02e19b89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b82 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004486:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b42877d5, rc 0) 00000100:00100000:0.0:1788748258.004514:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000e271e7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:7440:x1875638388528384:12345-0@lo:101: Request processed in 142us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748258.004520:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748258.004551:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528384:0@lo:101: 00010000:00010000:0.0:1788748258.004560:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000a655f860/0x9ba0f20a02e19b82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b89 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004583:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000a655f860/0x9ba0f20a02e19b82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19b89 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748258.004598:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788748258.004607:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000a655f860/0x9ba0f20a02e19b82 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b89 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004613:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000a655f860/0x9ba0f20a02e19b82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b89 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748258.004620:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8add8f106000 10000000:01000000:0.0:1788748258.004640:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788748258.004643:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8add8f106000 from 1 10000000:01000000:0.0:1788748258.004644:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788748258.004655:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000062e146a6/0x9ba0f20a02e19b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004661:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000062e146a6/0x9ba0f20a02e19b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.004668:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000062e146a6/0x9ba0f20a02e19b90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.004676:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528512:0@lo:101: 00000100:00100000:0.0:1788748258.004697:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.004712:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000837832b1 going to sleep for 11 seconds 00000100:00100000:0.0:1788748258.004722:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528512 00000100:00100000:0.0:1788748258.004725:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528512 00010000:00010000:1.0:1788748258.004820:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748258.004826:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.004838:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000024f29acb already unused, calling callback (000000006e8bf550) 10000000:00010000:1.0:1788748258.004840:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.004847:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748258.004853:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748258.004869:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748258.004886:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.004892:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748258.004908:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.004915:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 0000000024f29acb/0x9ba0f20a02e19b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19b7b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.004931:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748258.004932:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748258.004934:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748258.004940:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748258.004949:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7af6bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388528640:0@lo:103: 00000100:00100000:1.0:1788748258.004972:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.005024:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788748258.005030:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000055c35e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+11:7440:x1875638388528512:12345-0@lo:101: 00010000:00010000:0.0:1788748258.005037:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748258.005044:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b90 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.005066:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b90 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.005073:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e2731a12/0x9ba0f20a02e19b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b90 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.005079:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e2731a12, rc 0) 00000100:00100000:0.0:1788748258.005111:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000055c35e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388528512:12345-0@lo:101: Request processed in 82us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748258.005117:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788748258.005228:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528512:0@lo:101: 00010000:00010000:1.0:1788748258.005237:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000062e146a6/0x9ba0f20a02e19b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.005244:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000062e146a6/0x9ba0f20a02e19b90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748258.005254:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788748258.005264:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000062e146a6/0x9ba0f20a02e19b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.005280:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000062e146a6/0x9ba0f20a02e19b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748258.005285:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788748258.005289:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748258.005293:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8add8f106000 10000000:01000000:1.0:1788748258.005295:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788748258.005297:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788748258.005299:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788748258.005311:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000016f3aba9/0x9ba0f20a02e19b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.005340:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000016f3aba9/0x9ba0f20a02e19b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.005347:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000016f3aba9/0x9ba0f20a02e19b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748258.005358:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528768:0@lo:101: 00000100:00100000:1.0:1788748258.005383:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748258.005399:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000005988171b going to sleep for 11 seconds 00000100:00100000:2.0:1788748258.005485:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528768 00000100:00100000:2.0:1788748258.005490:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528768 00000100:00100000:2.0:1788748258.005514:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748258.005519:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074afc976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388528768:12345-0@lo:101: 00010000:00010000:2.0:1788748258.005526:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748258.005533:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c78f4bd7/0x9ba0f20a02e19ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19b9e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748258.005546:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c78f4bd7/0x9ba0f20a02e19ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748258.005553:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c78f4bd7/0x9ba0f20a02e19ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748258.005559:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c78f4bd7, rc 0) 00000100:00100000:2.0:1788748258.005581:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074afc976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:7440:x1875638388528768:12345-0@lo:101: Request processed in 63us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.005586:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788748258.005672:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528768:0@lo:101: 00010000:00010000:1.0:1788748258.005682:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000016f3aba9/0x9ba0f20a02e19b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.005688:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000016f3aba9/0x9ba0f20a02e19b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748258.005831:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528896:0@lo:501: 00000100:00100000:1.0:1788748258.005857:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748258.005885:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000005988171b going to sleep for 11 seconds 00000100:00100000:3.0:1788748258.005972:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528896 00000100:00100000:3.0:1788748258.005977:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528896 00000100:00100000:3.0:1788748258.006007:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788748258.006013:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c93fb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:7440:x1875638388528896:12345-0@lo:501: 00000100:00100000:3.0:1788748258.006119:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c93fb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:7440:x1875638388528896:12345-0@lo:501: Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.006126:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788748258.006154:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388528640 00000100:00100000:3.0:1788748258.006158:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388528640 00000100:00100000:3.0:1788748258.006196:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748258.006201:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fabc7ff3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:3638:x1875638388528640:12345-0@lo:103: 00010000:00010000:3.0:1788748258.006209:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748258.006219:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b87f690c/0x9ba0f20a02e19b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19b74 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.006230:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748258.006258:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fabc7ff3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3638:x1875638388528640:12345-0@lo:103: Request processed in 57us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.006263:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748258.006289:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7af6bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388528640:0@lo:103: 00000100:00100000:1.0:1788748258.006389:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388528896:0@lo:501: 00000100:00100000:1.0:1788748258.006493:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529024:0@lo:503: 00000100:00100000:1.0:1788748258.006532:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748258.006554:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000005988171b going to sleep for 11 seconds 00000100:00100000:2.0:1788748258.006613:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529024 00000100:00100000:2.0:1788748258.006617:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529024 00000100:00100000:2.0:1788748258.006644:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788748258.006650:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be144de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388529024:12345-0@lo:503: 00000100:00100000:2.0:1788748258.006727:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be144de6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388529024:12345-0@lo:503: Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.006733:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748258.006871:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529024:0@lo:503: 00000040:00080000:1.0:1788748258.007122:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748258.007184:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529152:0@lo:502: 00000100:00100000:1.0:1788748258.007219:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748258.007241:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000005988171b going to sleep for 11 seconds 00000100:00100000:2.0:1788748258.007472:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529152 00000100:00100000:2.0:1788748258.007478:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529152 00000100:00100000:2.0:1788748258.007503:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788748258.007509:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000530c1fe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388529152:12345-0@lo:502: 00000100:00100000:2.0:1788748258.007611:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000530c1fe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388529152:12345-0@lo:502: Request processed in 102us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.007618:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748258.007815:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078243990 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529152:0@lo:502: 00000040:00080000:0.0:1788748258.008033:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788748258.008075:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1788748258.008088:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1788748258.008100:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1788748258.008111:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1788748258.008124:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1788748258.008137:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1788748258.008150:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1788748258.008162:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1788748258.008174:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1788748258.008187:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1788748258.008199:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1788748258.008212:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1788748258.008234:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1788748258.008247:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1788748258.008260:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1788748258.008273:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1788748258.008286:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1788748258.008598:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1788748258.008622:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1788748258.008636:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1788748258.008649:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1788748258.008661:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788748258.008697:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000023b498ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529280:0@lo:502: 00000100:00100000:0.0:1788748258.008828:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.008902:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000000338f82b going to sleep for 11 seconds 00000100:00100000:2.0:1788748258.008941:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529280 00000100:00100000:2.0:1788748258.008948:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529280 00000100:00100000:2.0:1788748258.009059:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788748258.009068:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac968b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388529280:12345-0@lo:502: 00000100:00100000:2.0:1788748258.009168:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac968b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388529280:12345-0@lo:502: Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.009176:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748258.009242:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000023b498ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529280:0@lo:502: 00000040:00080000:0.0:1788748258.009287:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788748258.009296:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788748258.009941:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748258.009953:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748258.009956:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788748258.009962:0:7452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788748258.009965:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748258.009985:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000d0879a6c) 00000020:00000080:1.0:1788748258.010003:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788748258.010011:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788748258.010095:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788748258.010102:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e19bb3 00000020:00000080:1.0:1788748258.010306:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788748258.010311:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748258.010350:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748258.010351:0:7452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788748258.010355:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748258.010365:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748258.010366:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788748258.010370:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748258.010378:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000829e7974) 00000020:00000080:1.0:1788748258.010388:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788748258.010392:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788748258.010394:0:7452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788748258.010396:0:7452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788748258.010537:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748258.010587:0:7452:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb8085c5 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788748258.010599:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000c61755a0) 00000020:00000080:1.0:1788748258.010608:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788748258.010657:0:7452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788748258.010663:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e19bc8 00000020:00000080:1.0:1788748258.010956:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788748258.010963:0:7452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788748258.010968:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9ba0f20a02e19bcf 00080000:01000000:1.0:1788748258.010974:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788748258.010977:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e19bd6 00080000:10000000:1.0:1788748258.011542:0:7452:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788748258.011679:0:7452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788748258.098911:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788748258.099165:0:7452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788748258.102678:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788748258.103185:0:7452:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788748258.116023:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788748258.116038:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748258.116055:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.116059:0:7452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788748258.116062:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748258.116069:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.116070:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788748258.116074:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788748258.116079:0:7452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:3.0:1788748258.116107:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748258.116120:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000003466d457) 00000020:00000080:3.0:1788748258.116140:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788748258.116144:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788748258.116296:0:7452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788748258.116302:0:7452:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788748258.116309:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e19be4 00010000:00080000:3.0:1788748258.116369:0:7452:0:(ldlm_lib.c:103:import_set_conn()) imp 000000009b75d137@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788748258.120240:0:7452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788748258.124605:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788748258.124626:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788748258.124661:0:7452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788748258.124683:0:7452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e19beb 00000100:00080000:3.0:1788748258.124692:0:7452:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748258.124702:0:7452:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000009b75d137 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748258.124734:0:7452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f4f9e3f7 x1875638388529408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748258.124909:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4f9e3f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388529408:0@lo:38: 00000100:00100000:0.0:1788748258.124970:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748258.125038:0:7452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788748258.125115:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc2c18ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388529536:0@lo:400: 00000100:00100000:3.0:1788748258.125145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.125181:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388529664:0@lo:400: 00000100:00100000:3.0:1788748258.125210:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.125245:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529536 00000100:00100000:3.0:1788748258.125251:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529536 00000100:00100000:3.0:1788748258.125282:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748258.125289:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e354d984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3638:x1875638388529536:12345-0@lo:400: 00000100:00100000:3.0:1788748258.125350:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e354d984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:3638:x1875638388529536:12345-0@lo:400: Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.125356:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748258.125393:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc2c18ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388529536:0@lo:400: 00000020:01000000:3.0:1788748258.125454:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748258.125458:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.125459:0:7452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788748258.125462:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788748258.125464:0:7452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788748258.125466:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788748258.125467:0:7452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788748258.125469:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788748258.125477:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.125478:0:7452:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788748258.125481:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748258.125485:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.125486:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788748258.125490:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788748258.125522:0:7452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788748258.125532:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748258.125535:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.125536:0:7452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788748258.125538:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748258.125540:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.125542:0:7452:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788748258.125544:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788748258.125545:0:7452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788748258.125572:0:7452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748258.125575:0:7452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748258.125576:0:7452:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788748258.125579:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788748258.125857:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529408 00000100:00100000:1.0:1788748258.125863:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529408 00000100:00100000:1.0:1788748258.125888:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748258.125892:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000023b498ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875638388529408:12345-0@lo:38: 00010000:00080000:1.0:1788748258.125909:0:6515:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:1.0:1788748258.125938:0:6515:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e19bf2 00000004:00100000:1.0:1788748258.125951:0:6515:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788748258.125956:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788748258.128370:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529664 00000100:00100000:3.0:1788748258.128384:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529664 00000100:00100000:3.0:1788748258.128446:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748258.128454:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df4ffabb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388529664:12345-0@lo:400: 00000100:00100000:3.0:1788748258.128545:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df4ffabb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388529664:12345-0@lo:400: Request processed in 92us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.128552:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788748258.128597:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000904d367 x1875638388529664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748258.128612:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388529664:0@lo:400: 00000020:01000000:1.0:1788748258.129396:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788748258.129504:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788748258.129534:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000016f3aba9/0x9ba0f20a02e19b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.129545:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000016f3aba9/0x9ba0f20a02e19b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748258.129553:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add8f106000 from 1 10000000:01000000:1.0:1788748258.129556:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788748258.129599:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.129606:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.129615:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748258.129635:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ffbdbf7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529792:0@lo:101: 00000100:00100000:1.0:1788748258.129683:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748258.129954:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000004dda1ddc going to sleep for 11 seconds 00000100:00100000:3.0:1788748258.130188:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529792 00000100:00100000:3.0:1788748258.130203:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529792 00000100:00100000:3.0:1788748258.130277:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788748258.130285:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003393fe6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+12:7440:x1875638388529792:12345-0@lo:101: 00010000:00010000:3.0:1788748258.130297:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748258.130308:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19bf9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.130392:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.130504:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.130513:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cde20e7c, rc 0) 00000100:00100000:3.0:1788748258.130566:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003393fe6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:7440:x1875638388529792:12345-0@lo:101: Request processed in 283us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.130572:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788748258.130646:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ffbdbf7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529792:0@lo:101: 00010000:00010000:0.0:1788748258.130662:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.130669:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.131239:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529920:0@lo:256: 00000100:00100000:0.0:1788748258.131969:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.132021:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000000338f82b going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.133031:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388529920 00000100:00100000:1.0:1788748258.133198:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388529920 00000100:00100000:1.0:1788748258.133551:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748258.133562:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c24e25d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:7440:x1875638388529920:12345-0@lo:256: 20000000:01000000:1.0:1788748258.133587:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788748258.133608:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788748258.133612:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788748258.133748:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c24e25d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:7440:x1875638388529920:12345-0@lo:256: Request processed in 188us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.133758:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748258.136564:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388529920:0@lo:256: 10000000:01000000:0.0:1788748258.137184:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748258.137205:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.137217:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748258.137226:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add8f106000 from 1 10000000:01000000:0.0:1788748258.137228:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748258.137261:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.137269:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.137278:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.137296:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530048:0@lo:101: 00000100:00100000:0.0:1788748258.137380:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.137431:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000000338f82b going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.137561:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530048 00000100:00100000:1.0:1788748258.137569:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530048 00000100:00100000:1.0:1788748258.137619:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748258.137629:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e3ec637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:7440:x1875638388530048:12345-0@lo:101: 00010000:00010000:1.0:1788748258.137642:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748258.137653:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19c07 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.137677:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.137687:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.137696:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040cac1c2, rc 0) 00000100:00100000:1.0:1788748258.137744:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e3ec637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:7440:x1875638388530048:12345-0@lo:101: Request processed in 118us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.137751:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788748258.137806:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530048:0@lo:101: 00010000:00010000:0.0:1788748258.137829:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.137838:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.137938:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530176:0@lo:501: 00000100:00100000:0.0:1788748258.137964:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.137987:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000000338f82b going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.138881:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530176 00000100:00100000:1.0:1788748258.138890:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530176 00000100:00100000:1.0:1788748258.138938:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788748258.138946:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d0b2a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:7440:x1875638388530176:12345-0@lo:501: 00000100:00100000:1.0:1788748258.139667:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d0b2a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:7440:x1875638388530176:12345-0@lo:501: Request processed in 719us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.139676:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788748258.139951:0:6515:0:(import.c:65:import_set_state_nolock()) 00000000d3ea09d5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748258.140019:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000023b498ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875638388529408:12345-0@lo:38: Request processed in 14125us (15048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.140032:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748258.140124:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530176:0@lo:501: 00000100:00100000:0.0:1788748258.140173:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530304:0@lo:503: 00000100:00100000:0.0:1788748258.140217:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.140256:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000000338f82b going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.140361:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748258.140370:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788748258.140377:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788748258.140382:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788748258.140390:0:3634:0:(import.c:65:import_set_state_nolock()) 000000009b75d137 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748258.140504:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530304 00000100:00100000:2.0:1788748258.140511:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530304 00000100:00100000:2.0:1788748258.140541:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748258.140548:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c99f416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:7440:x1875638388530304:12345-0@lo:503: 00000040:00080000:2.0:1788748258.140585:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748258.140625:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c99f416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:7440:x1875638388530304:12345-0@lo:503: Request processed in 77us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.140632:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748258.140758:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4f9e3f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388529408:0@lo:38: 00000100:00100000:0.0:1788748258.140837:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530304:0@lo:503: 00000040:00080000:0.0:1788748258.141063:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748258.141108:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788748258.141193:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748258.142142:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788748258.142355:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788748258.142382:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748258.142398:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.142420:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748258.142469:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788748258.142472:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8add8f106000 10000000:01000000:1.0:1788748258.142475:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8add8f106000 10000000:01000000:1.0:1788748258.142479:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748258.142484:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8add8f106000 from 1 10000000:01000000:1.0:1788748258.142487:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788748258.142519:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000f79bf781/0x9ba0f20a02e19c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.142526:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000f79bf781/0x9ba0f20a02e19c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.142536:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000f79bf781/0x9ba0f20a02e19c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748258.142555:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2c1eecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530432:0@lo:101: 00000100:00100000:1.0:1788748258.142609:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748258.142643:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd37c9c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788748258.142936:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530432 00000100:00100000:0.0:1788748258.142943:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530432 00000100:00100000:0.0:1788748258.142982:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748258.142988:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009577dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:7440:x1875638388530432:12345-0@lo:101: 00010000:00010000:0.0:1788748258.143001:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748258.143011:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c635385/0x9ba0f20a02e19c1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19c15 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.143030:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c635385/0x9ba0f20a02e19c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.143039:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c635385/0x9ba0f20a02e19c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.143074:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c635385, rc 0) 00000100:00100000:0.0:1788748258.143115:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009577dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388530432:12345-0@lo:101: Request processed in 127us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748258.143121:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748258.143177:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2c1eecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530432:0@lo:101: 00010000:00010000:0.0:1788748258.143191:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000f79bf781/0x9ba0f20a02e19c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.143198:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000f79bf781/0x9ba0f20a02e19c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.143275:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530560:0@lo:501: 00000100:00100000:0.0:1788748258.143303:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.143356:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e8fb498 going to sleep for 11 seconds 00000100:00100000:2.0:1788748258.143589:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530560 00000100:00100000:2.0:1788748258.143594:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530560 00000100:00100000:2.0:1788748258.143629:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788748258.143635:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006e67d9d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388530560:12345-0@lo:501: 00000100:00100000:2.0:1788748258.143753:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006e67d9d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388530560:12345-0@lo:501: Request processed in 119us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.143766:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788748258.143926:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530560:0@lo:501: 00000100:00100000:0.0:1788748258.143954:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530688:0@lo:503: 00000100:00100000:0.0:1788748258.143992:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.144023:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e8fb498 going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.144073:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530688 00000100:00100000:1.0:1788748258.144079:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530688 00000100:00100000:1.0:1788748258.144120:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748258.144126:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fcd844a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388530688:12345-0@lo:503: 00000100:00100000:1.0:1788748258.144222:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fcd844a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388530688:12345-0@lo:503: Request processed in 97us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.144229:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788748258.144359:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530688:0@lo:503: 00000040:00080000:0.0:1788748258.144685:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788748258.144749:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530816:0@lo:502: 00000100:00100000:0.0:1788748258.144788:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.145291:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e8fb498 going to sleep for 11 seconds 00000100:00100000:3.0:1788748258.145472:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748258.145482:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388530944:0@lo:41: 00000100:00100000:3.0:1788748258.145519:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748258.145694:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530816 00000100:00100000:2.0:1788748258.145701:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530816 00000100:00100000:2.0:1788748258.145774:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788748258.145781:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000525eeade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388530816:12345-0@lo:502: 00000100:00100000:2.0:1788748258.145959:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000525eeade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388530816:12345-0@lo:502: Request processed in 179us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.145966:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788748258.146073:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388530816:0@lo:502: 00000040:00080000:0.0:1788748258.146340:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788748258.146370:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788748258.146385:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788748258.146396:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000100:00100000:3.0:1788748258.147539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388530944 00000100:00100000:3.0:1788748258.147549:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388530944 00000100:00100000:3.0:1788748258.147590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748258.147598:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc2c18ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1875638388530944:12345-0@lo:41: 00000004:00000024:3.0:1788748258.147630:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788748258.147708:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc2c18ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1875638388530944:12345-0@lo:41: Request processed in 112us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.147715:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748258.147758:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388530944:0@lo:41: 00000040:00080000:0.0:1788748258.147992:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788748258.148011:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788748258.148023:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788748258.148054:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788748258.148071:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788748258.148101:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788748258.148118:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788748258.148130:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788748258.148142:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788748258.148169:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788748258.148184:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788748258.148197:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788748258.148211:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788748258.148225:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788748258.148236:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788748258.148248:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788748258.148261:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788748258.148274:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788748258.148289:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788748258.148303:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788748258.148339:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788748258.148369:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788748258.148386:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788748258.148512:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788748258.148552:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388531072:0@lo:502: 00000100:00100000:0.0:1788748258.148603:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.148641:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e8fb498 going to sleep for 11 seconds 00000100:00100000:3.0:1788748258.148781:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531072 00000100:00100000:3.0:1788748258.148787:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531072 00000100:00100000:3.0:1788748258.148916:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788748258.148924:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ac55309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388531072:12345-0@lo:502: 00000100:00100000:3.0:1788748258.149025:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ac55309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388531072:12345-0@lo:502: Request processed in 103us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.149032:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748258.149200:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066fa92ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388531072:0@lo:502: 00000040:00080000:0.0:1788748258.149247:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788748258.149255:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788748258.149956:0:7458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788748258.149970:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000002f4c9d0) 00000020:00000080:0.0:1788748258.149989:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788748258.150077:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb8085c5 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788748258.150081:0:7458:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000eb8085c5 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788748258.150083:0:7458:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000eb8085c5 3 00010000:00080000:0.0:1788748258.150111:0:7458:0:(ldlm_lib.c:103:import_set_conn()) imp 000000009e6150ed@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748258.152914:0:7458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788748258.153252:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788748258.153293:0:7458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788748258.153303:0:7458:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9ba0f20a02e19c2a 00000100:00080000:1.0:1788748258.153312:0:7458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748258.153466:0:7458:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009e6150ed using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748258.153499:0:7458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f63e982b x1875638388531200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748258.153544:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f63e982b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388531200:0@lo:38: 00000100:00100000:0.0:1788748258.153601:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748258.153659:0:7458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788748258.153720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531200 00000100:00100000:3.0:1788748258.153728:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531200 00000100:00100000:3.0:1788748258.153763:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748258.153769:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000066fa92ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875638388531200:12345-0@lo:38: 00010000:00080000:3.0:1788748258.153788:0:6512:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1788748258.153826:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9ba0f20a02e19c31 00000004:00100000:3.0:1788748258.153840:0:6512:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788748258.153863:0:6512:0:(import.c:65:import_set_state_nolock()) 000000005303810c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748258.161340:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000066fa92ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875638388531200:12345-0@lo:38: Request processed in 7560us (7729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.161356:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 40000000:00080000:2.0:1788748258.161923:0:7460:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000040:00080000:3.0:1788748258.161940:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788748258.162025:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788748258.162065:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788748258.162086:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000f79bf781/0x9ba0f20a02e19c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.162114:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000f79bf781/0x9ba0f20a02e19c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788748258.162720:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f63e982b x1875638388531200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748258.162734:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748258.162744:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788748258.162752:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788748258.162757:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788748258.162760:0:3634:0:(import.c:65:import_set_state_nolock()) 000000009e6150ed lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788748258.162768:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f63e982b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388531200:0@lo:38: 00000020:01000004:3.0:1788748258.163636:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788748258.163640:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748258.163641:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748258.163642:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748258.163643:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748258.163645:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748258.163646:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748258.163647:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748258.163648:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748258.163650:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748258.163651:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748258.163655:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788748258.163658:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748258.163659:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748258.163660:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748258.163661:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748258.163662:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748258.163663:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748258.163664:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748258.163665:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748258.163666:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748258.163667:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748258.163668:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748258.163693:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788748258.163710:0:7440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388531328:0@lo:253: 00000100:00100000:3.0:1788748258.163774:0:7440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.163861:0:7440:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f53102d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788748258.163959:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531328 00000100:00100000:0.0:1788748258.163966:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531328 00000100:00100000:0.0:1788748258.164044:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788748258.164062:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abd7289d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388531328:12345-0@lo:253: 20000000:01000000:0.0:1788748258.164086:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788748258.164097:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788748258.167827:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788748258.167925:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788748258.167951:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788748258.168067:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788748258.168073:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788748258.168093:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.168134:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.168141:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.168157:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.168194:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.168208:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 15 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748258.168221:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011c4a760 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388531456:0@lo:104: 00000100:00100000:3.0:1788748258.168282:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748258.168363:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.168371:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 15 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748258.168378:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2ba215a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388531584:0@lo:104: 00000100:00100000:3.0:1788748258.168498:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.168527:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc900676 going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.168614:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531456 00000100:00100000:1.0:1788748258.168622:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531456 00000100:00100000:1.0:1788748258.168655:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531584 00000100:00100000:1.0:1788748258.168658:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531584 00000100:00100000:1.0:1788748258.168670:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748258.168677:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bb3b425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6526:x1875638388531456:12345-0@lo:104: 00010000:00010000:1.0:1788748258.168688:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.168755:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748258.168760:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bb3b425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6526:x1875638388531456:12345-0@lo:104: Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.168767:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748258.168785:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748258.168799:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000079aa5fe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388531584:12345-0@lo:104: 00010000:00010000:1.0:1788748258.168807:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.168944:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748258.168949:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.168956:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ebf7caf4 already unused, calling callback (000000006e8bf550) 10000000:00010000:0.0:1788748258.168959:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.168967:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748258.168973:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748258.168979:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748258.169007:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.169013:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788748258.169015:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abd7289d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7440:x1875638388531328:12345-0@lo:253: Request processed in 4956us (5242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748258.169023:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788748258.169029:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.169035:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000ebf7caf4/0x9ba0f20a02e19bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c00 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.169059:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748258.169061:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748258.169062:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748258.169072:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce0c2950 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388531712:0@lo:103: 00000100:00100000:2.0:1788748258.169082:0:7440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000904d367 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:7440:1875638388531328:0@lo:253: 10000000:01000000:2.0:1788748258.169093:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788748258.169096:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748258.169097:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788748258.169099:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:0.0:1788748258.169099:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788748258.169100:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748258.169101:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748258.169102:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748258.169104:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788748258.169105:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748258.169106:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748258.169108:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748258.169109:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788748258.169122:0:7440:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788748258.169141:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531712 00000100:00100000:0.0:1788748258.169144:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531712 00010000:00010000:0.0:1788748258.169173:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 15 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.169194:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748258.169200:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d8fdaa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3637:x1875638388531712:12345-0@lo:103: 00010000:00010000:0.0:1788748258.169209:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748258.169213:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 15 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.169221:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 15 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748258.169236:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748258.169260:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d8fdaa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3637:x1875638388531712:12345-0@lo:103: Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748258.169266:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748258.169296:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce0c2950 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388531712:0@lo:103: 00010000:00010000:1.0:1788748258.169503:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748258.169508:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000079aa5fe7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388531584:12345-0@lo:104: Request processed in 711us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.169515:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788748258.169530:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748258.169534:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.169540:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000065e03433 already unused, calling callback (000000006e8bf550) 10000000:00010000:1.0:1788748258.169542:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.169549:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748258.169555:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748258.169560:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748258.169578:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.169584:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748258.169592:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.169609:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 0000000065e03433/0x9ba0f20a02e19b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.169622:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748258.169623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748258.169625:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748258.169692:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cde20e7c/0x9ba0f20a02e19c00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19bf9 expref: 14 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748258.169713:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011c4a760 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388531456:0@lo:104: 00000100:00100000:3.0:1788748258.169724:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2ba215a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388531584:0@lo:104: 00010000:00010000:3.0:1788748258.169739:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748258.169786:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000784a9637 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388531840:0@lo:103: 00000100:00100000:0.0:1788748258.169815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.169994:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531840 00000100:00100000:3.0:1788748258.170000:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531840 00010000:00010000:3.0:1788748258.170016:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 14 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748258.170043:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748258.170059:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000521b385d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:3638:x1875638388531840:12345-0@lo:103: 00010000:00010000:3.0:1788748258.170068:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748258.170071:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 14 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170080:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 14 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170091:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19b51 expref: 14 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170101:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170108:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788748258.170120:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002048055s 00010000:00010000:3.0:1788748258.170131:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170137:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170142:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170206:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170211:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ac2dfd5a already unused, calling callback (000000002d9bebd3) 00010000:00010000:3.0:1788748258.170215:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170220:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170241:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748258.170251:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748258.170282:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000521b385d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:3638:x1875638388531840:12345-0@lo:103: Request processed in 224us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748258.170288:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748258.170400:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000784a9637 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388531840:0@lo:103: 00010000:00010000:1.0:1788748258.170527:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.170535:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748258.170541:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ac2dfd5a/0x9ba0f20a02e19c38 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788748258.177039:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788748258.178591:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788748258.179112:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788748258.179509:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788748258.179974:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788748258.182376:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788748258.183925:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788748258.184441:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788748258.184633:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788748258.184808:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788748258.185475:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788748258.185985:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788748258.188554:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788748258.188807:0:7464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788748258.188864:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1875638388531968:0@lo:700: 00000100:00100000:2.0:1788748258.188927:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748258.188977:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000003eb739c4 going to sleep for 11 seconds 00000040:01000000:3.0:1788748258.189022:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788748258.189123:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388531968 00000100:00100000:0.0:1788748258.189131:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388531968 00000100:00100000:0.0:1788748258.189186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748258.189194:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d86a50e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1875638388531968:12345-0@lo:700: 00000100:00100000:3.0:1788748258.190156:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532096:0@lo:1000: 00000100:00100000:3.0:1788748258.190219:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.190259:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee49cba6 going to sleep for 11 seconds 00000100:00100000:0.0:1788748258.190460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388532096 00000100:00100000:0.0:1788748258.190466:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388532096 00000100:00100000:0.0:1788748258.190511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748258.190516:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b926474d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532096:12345-0@lo:1000: 00000100:00100000:0.0:1788748258.190594:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b926474d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532096:12345-0@lo:1000: Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748258.190601:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748258.191618:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532096:0@lo:1000: 00000040:01000000:3.0:1788748258.191664:0:7465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788748258.191697:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532224:0@lo:700: 00000100:00100000:3.0:1788748258.191751:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1788748258.191889:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788748258.192055:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748258.192360:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee49cba6 going to sleep for 11 seconds 00000004:00000080:2.0:1788748258.192723:0:7440:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788748258.192732:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788748258.192902:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748258.193931:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788748258.194530:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788748258.194589:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788748258.194781:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788748258.194997:0:7440:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00080000:1.0:1788748258.195802:0:7463:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788748258.195808:0:7463:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788748258.198524:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388532224 00000100:00100000:0.0:1788748258.198541:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388532224 00000100:00100000:0.0:1788748258.198641:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748258.198651:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ed780e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532224:12345-0@lo:700: 00000100:00100000:0.0:1788748258.198764:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ed780e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532224:12345-0@lo:700: Request processed in 116us (7013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748258.198771:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1788748258.200423:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788748258.200548:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788748258.200677:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788748258.201014:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788748258.201179:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:3.0:1788748258.202473:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532224:0@lo:700: 00000100:00100000:3.0:1788748258.202556:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875638388532352:0@lo:900: 00000100:00100000:3.0:1788748258.202617:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.202670:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee49cba6 going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.202749:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388532352 00000100:00100000:1.0:1788748258.202758:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388532352 00000100:00100000:1.0:1788748258.202809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748258.202818:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ba215a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1875638388532352:12345-0@lo:900: 00000100:00100000:1.0:1788748258.202883:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ba215a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1875638388532352:12345-0@lo:900: Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.202890:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788748258.203451:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d40ce6d9 x1875638388532352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788748274 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748258.203465:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875638388532352:0@lo:900: 00000100:00100000:3.0:1788748258.203596:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532480:0@lo:1000: 00000100:00100000:3.0:1788748258.203636:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.203661:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d740d128 going to sleep for 11 seconds 00000100:00100000:1.0:1788748258.204114:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388532480 00000100:00100000:1.0:1788748258.204122:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388532480 00000100:00100000:1.0:1788748258.204173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748258.204180:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000011c4a760 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532480:12345-0@lo:1000: 00000100:00100000:1.0:1788748258.204264:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000011c4a760 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532480:12345-0@lo:1000: Request processed in 85us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.204271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748258.204377:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532480:0@lo:1000: 00000004:00080000:3.0:1788748258.204425:0:7465:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ee49cba6 with version 0 00000020:00100000:3.0:1788748258.204441:0:7465:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788748258.204446:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d40ce6d9 x1875638388532736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748258.204458:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532736:0@lo:1000: 00000100:00100000:3.0:1788748258.204484:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.204507:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388532736 00000100:00100000:3.0:1788748258.204510:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388532736 00000100:00100000:3.0:1788748258.204531:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748258.204537:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067133745 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532736:12345-0@lo:1000: 40000000:02000000:1.0:1788748258.204561:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1788748258.204830:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000845cca62 going to sleep for 11 seconds 00100000:10000000:2.0:1788748258.205095:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788748258.205406:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788748258.205548:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788748258.205718:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788748258.206438:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788748258.206587:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788748258.210588:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788748258.210885:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788748258.211024:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788748258.211175:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788748258.211360:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788748258.211652:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788748258.211785:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788748258.211929:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788748258.212089:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788748258.212222:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788748258.212418:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788748258.212553:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000001:00080000:3.0:1788748258.214970:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788748258.215142:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067133745 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532736:12345-0@lo:1000: Request processed in 10601us (10653us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788748258.215156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788748258.215248:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788748258.215253:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788748258.215268:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532736:0@lo:1000: 00000100:00100000:3.0:1788748258.215385:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532864:0@lo:1000: 00000100:00100000:3.0:1788748258.215419:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748258.215456:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000002df23978 going to sleep for 11 seconds 00000100:00100000:0.0:1788748258.215504:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388532864 00000100:00100000:0.0:1788748258.215510:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388532864 00000100:00100000:0.0:1788748258.215547:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748258.215554:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022d24155 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532864:12345-0@lo:1000: 00000100:00100000:0.0:1788748258.215612:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022d24155 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875638388532864:12345-0@lo:1000: Request processed in 59us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748258.215618:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748258.215931:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1875638388532864:0@lo:1000: 00000040:00080000:3.0:1788748258.215948:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788748258.215975:0:7465:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000097b536d8 with version 1 00000004:00080000:0.0:1788748258.216984:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000002d87efff version 1 rpc_version 1 00000020:00100000:0.0:1788748258.217014:0:7455:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788748258.217022:0:7455:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ce0c2950 x1875638388533120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748258.217039:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce0c2950 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1875638388533120:0@lo:1000: 00000100:00100000:0.0:1788748258.217104:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748258.217140:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f6542c6 going to sleep for 11 seconds 00000100:00100000:0.0:1788748258.217159:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388533120 00000100:00100000:0.0:1788748258.217165:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388533120 00000100:00100000:0.0:1788748258.217204:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748258.217221:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000010cd6a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7455:x1875638388533120:12345-0@lo:1000: 00100000:10000000:2.0:1788748258.217598:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788748258.219511:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788748258.219688:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788748258.223167:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:1.0:1788748258.223682:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d86a50e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1875638388531968:12345-0@lo:700: Request processed in 34487us (34751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748258.223709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788748258.224362:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006239371c x1875638388531968/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788748274 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748258.224380:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1875638388531968:0@lo:700: 40000000:02000000:2.0:1788748258.224404:0:7464:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:0.0:1788748258.226448:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000040:00080000:3.0:1788748258.226717:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1788748258.226903:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000010cd6a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7455:x1875638388533120:12345-0@lo:1000: Request processed in 9680us (9794us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788748258.226916:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788748258.226936:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788748258.226941:0:7455:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788748258.226957:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce0c2950 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1875638388533120:0@lo:1000: 00000004:00080000:3.0:1788748258.228984:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1788748258.230196:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788748258.231787:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788748258.231944:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788748258.232134:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788748258.232367:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788748258.232569:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788748258.239394:0:7440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788748258.239434:0:7440:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaf7081c4f988 00100000:10000000:3.0:1788748258.239443:0:7440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788748258.256111:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788748258.256146:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788748258.256166:0:7440:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788748258.256182:0:7440:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788748258.258545:0:7440:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788748258.258763:0:7440:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788748258.269425:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748258.285405:0:7464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788748258.285492:0:7464:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788748258.285497:0:7464:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788748258.601963:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748259.620687:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748260.644725:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748261.668452:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748262.512554:0:7709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788748262.693469:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748263.204960:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388533248:0@lo:41: 00000100:00100000:0.0:1788748263.205045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748263.205162:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388533248 00000100:00100000:3.0:1788748263.205171:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388533248 00000100:00100000:3.0:1788748263.205224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748263.205231:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ce0c2950 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388533248:12345-0@lo:41: 00000004:00000024:3.0:1788748263.205267:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788748263.205313:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ce0c2950 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388533248:12345-0@lo:41: Request processed in 83us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748263.205339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748263.205379:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388533248:0@lo:41: 00000100:00100000:1.0:1788748263.207425:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388533504:0@lo:400: 00000100:00100000:1.0:1788748263.207487:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748263.207532:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748263.207538:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f72d232b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388533632:0@lo:400: 00000100:00100000:1.0:1788748263.207565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748263.207622:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ca8bfb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388533376:0@lo:400: 00000100:00100000:0.0:1788748263.207656:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748263.207701:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388533376 00000100:00100000:0.0:1788748263.207708:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388533376 00000100:00100000:0.0:1788748263.207760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788748263.207768:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec979c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:3636:x1875638388533376:12345-0@lo:400: 00000100:00100000:0.0:1788748263.207812:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec979c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:3636:x1875638388533376:12345-0@lo:400: Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748263.207819:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788748263.207871:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ca8bfb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388533376:0@lo:400: 00000100:00100000:2.0:1788748263.219266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388533504 00000100:00100000:2.0:1788748263.219282:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388533504 00000100:00100000:2.0:1788748263.219354:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388533632 00000100:00100000:2.0:1788748263.219358:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388533632 00000100:00100000:2.0:1788748263.219379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748263.219388:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054d5c45c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388533504:12345-0@lo:400: 00000100:00100000:2.0:1788748263.219488:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054d5c45c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388533504:12345-0@lo:400: Request processed in 101us (12002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748263.219495:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748263.219513:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748263.219519:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d9a69fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388533632:12345-0@lo:400: 00000100:00100000:2.0:1788748263.219547:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d9a69fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388533632:12345-0@lo:400: Request processed in 29us (11982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748263.219552:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788748263.220416:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f72d232b x1875638388533632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748263.220434:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f72d232b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388533632:0@lo:400: 00010000:00080000:0.0:1788748263.220446:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000044fd40fa x1875638388533504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748263.220454:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388533504:0@lo:400: 00000020:00000004:3.0:1788748263.402991:0:7762:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788748263.403593:0:7762:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788748263.717480:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748264.741053:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748265.252425:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748265.252434:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add8f106000 from 4 10000000:01000000:0.0:1788748265.252439:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748265.252491:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.252504:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.252515:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19c3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748265.252540:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388533760:0@lo:101: 00000100:00100000:0.0:1788748265.252609:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.252760:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388533760 00000100:00100000:2.0:1788748265.252768:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388533760 00000100:00100000:2.0:1788748265.252813:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788748265.252821:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af9ec4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:6507:x1875638388533760:12345-0@lo:101: 00010000:00010000:2.0:1788748265.252835:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748265.252847:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069a55ffc/0x9ba0f20a02e19c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19c3f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748265.252866:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069a55ffc/0x9ba0f20a02e19c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748265.252881:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069a55ffc/0x9ba0f20a02e19c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748265.252903:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069a55ffc, rc 0) 00000100:00100000:2.0:1788748265.252938:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af9ec4cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:6507:x1875638388533760:12345-0@lo:101: Request processed in 117us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.252943:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788748265.253505:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000626b073d going to sleep for 11 seconds 00000100:00100000:0.0:1788748265.253528:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388533760:0@lo:101: 00010000:00010000:0.0:1788748265.253548:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.253556:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19c3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748265.253619:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388533888:0@lo:256: 00000100:00100000:0.0:1788748265.253649:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748265.253672:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000626b073d going to sleep for 11 seconds 00000100:00100000:1.0:1788748265.253756:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388533888 00000100:00100000:1.0:1788748265.253762:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388533888 00000100:00100000:1.0:1788748265.253795:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748265.253801:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d455e9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:6507:x1875638388533888:12345-0@lo:256: 20000000:01000000:1.0:1788748265.253815:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788748265.253829:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788748265.253832:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788748265.253911:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d455e9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:6507:x1875638388533888:12345-0@lo:256: Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.253918:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788748265.254042:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388533888:0@lo:256: 10000000:01000000:0.0:1788748265.254398:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748265.254404:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19c3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.254411:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000007ab7ec9e/0x9ba0f20a02e19c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748265.254419:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788748265.254421:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adda7357000 from 21 10000000:01000000:0.0:1788748265.254423:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748265.254439:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000002be2698c/0x9ba0f20a02e19c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.254446:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000002be2698c/0x9ba0f20a02e19c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.254452:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000002be2698c/0x9ba0f20a02e19c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748265.254463:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534016:0@lo:101: 00000100:00100000:0.0:1788748265.254865:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748265.254902:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000626b073d going to sleep for 11 seconds 00000100:00100000:1.0:1788748265.254957:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534016 00000100:00100000:1.0:1788748265.254963:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534016 00000100:00100000:1.0:1788748265.255040:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748265.255389:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a4a15bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:6507:x1875638388534016:12345-0@lo:101: 00010000:00010000:1.0:1788748265.255404:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748265.255416:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19c4d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748265.255438:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748265.255447:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000831af9ff/0x9ba0f20a02e19c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748265.255455:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000831af9ff, rc 0) 00000100:00100000:1.0:1788748265.255505:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a4a15bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388534016:12345-0@lo:101: Request processed in 458us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.255511:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788748265.255712:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534016:0@lo:101: 00010000:00010000:0.0:1788748265.255737:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000002be2698c/0x9ba0f20a02e19c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.255745:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000002be2698c/0x9ba0f20a02e19c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748265.255805:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534144:0@lo:501: 00000100:00100000:0.0:1788748265.255832:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748265.255868:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000626b073d going to sleep for 11 seconds 00000100:00100000:2.0:1788748265.256353:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534144 00000100:00100000:2.0:1788748265.256361:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534144 00000100:00100000:2.0:1788748265.256402:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788748265.256409:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000daf95b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388534144:12345-0@lo:501: 00000100:00100000:2.0:1788748265.256545:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000daf95b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388534144:12345-0@lo:501: Request processed in 137us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.256552:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748265.256840:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d8fdaa2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534144:0@lo:501: 00000100:00100000:1.0:1788748265.256875:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534272:0@lo:503: 00000100:00100000:1.0:1788748265.256921:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748265.257007:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a0a6984 going to sleep for 11 seconds 00000100:00100000:0.0:1788748265.257047:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534272 00000100:00100000:0.0:1788748265.257262:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534272 00000100:00100000:0.0:1788748265.257302:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788748265.257309:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074f5f5e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388534272:12345-0@lo:503: 00000100:00100000:0.0:1788748265.257508:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074f5f5e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388534272:12345-0@lo:503: Request processed in 200us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748265.257516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748265.257629:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534272:0@lo:503: 00000100:00100000:3.0:1788748265.258123:0:7814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7814:1875638388534400:0@lo:502: 00000100:00100000:3.0:1788748265.258164:0:7814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.258363:0:7814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc06a5f4 going to sleep for 11 seconds 00000100:00100000:0.0:1788748265.259155:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534400 00000100:00100000:0.0:1788748265.259224:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534400 00000100:00100000:0.0:1788748265.259873:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748265.259884:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cbfce4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7814:x1875638388534400:12345-0@lo:502: 00000100:00100000:0.0:1788748265.260057:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cbfce4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7814:x1875638388534400:12345-0@lo:502: Request processed in 166us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748265.260067:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788748265.260163:0:7814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7814:1875638388534400:0@lo:502: 00000100:00100000:3.0:1788748265.260221:0:7814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7814:1875638388534528:0@lo:502: 00000100:00100000:3.0:1788748265.260260:0:7814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.261759:0:7814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc06a5f4 going to sleep for 11 seconds 00000100:00100000:2.0:1788748265.261968:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534528 00000100:00100000:2.0:1788748265.261977:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534528 00000100:00100000:2.0:1788748265.262028:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788748265.262035:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000225049d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7814:x1875638388534528:12345-0@lo:502: 00000100:00100000:2.0:1788748265.262566:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000225049d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:7814:x1875638388534528:12345-0@lo:502: Request processed in 531us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.262574:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788748265.262876:0:7814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7814:1875638388534528:0@lo:502: 00000040:00080000:3.0:1788748265.262909:0:7814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788748265.263293:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788748265.263414:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748265.263423:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000002be2698c/0x9ba0f20a02e19c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.263450:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000002be2698c/0x9ba0f20a02e19c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748265.263460:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748265.263463:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adda7357000 from 4 10000000:01000000:0.0:1788748265.263466:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748265.263498:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000981933ab/0x9ba0f20a02e19c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.263506:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000981933ab/0x9ba0f20a02e19c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.263515:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000981933ab/0x9ba0f20a02e19c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748265.263534:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534656:0@lo:101: 00000100:00100000:0.0:1788748265.263581:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748265.263618:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee49cba6 going to sleep for 11 seconds 00000100:00100000:3.0:1788748265.263670:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534656 00000100:00100000:3.0:1788748265.263754:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534656 00000100:00100000:3.0:1788748265.263799:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788748265.263806:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ec19dc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388534656:12345-0@lo:101: 00010000:00010000:3.0:1788748265.263828:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748265.263839:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000605c754b/0x9ba0f20a02e19c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19c5b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.263863:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000605c754b/0x9ba0f20a02e19c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.263872:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000605c754b/0x9ba0f20a02e19c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.263880:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000605c754b, rc 0) 00000100:00100000:3.0:1788748265.263916:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ec19dc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388534656:12345-0@lo:101: Request processed in 111us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.263922:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788748265.264010:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534656:0@lo:101: 00010000:00010000:0.0:1788748265.264023:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000981933ab/0x9ba0f20a02e19c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748265.264031:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000981933ab/0x9ba0f20a02e19c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748265.264421:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534784:0@lo:256: 00000100:00100000:0.0:1788748265.264457:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748265.264496:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee49cba6 going to sleep for 11 seconds 00000100:00100000:3.0:1788748265.264551:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534784 00000100:00100000:3.0:1788748265.264556:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534784 00000100:00100000:3.0:1788748265.264590:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788748265.264597:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc7a5a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388534784:12345-0@lo:256: 20000000:01000000:3.0:1788748265.264610:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748265.264626:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748265.264629:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788748265.264718:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc7a5a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388534784:12345-0@lo:256: Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.264724:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788748265.264754:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080bc5902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534784:0@lo:256: 10000000:01000000:3.0:1788748265.264793:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788748265.264798:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000981933ab/0x9ba0f20a02e19c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.264813:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000981933ab/0x9ba0f20a02e19c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748265.264821:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788748265.264823:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788748265.264825:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788748265.264841:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.264847:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.264853:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748265.264864:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534912:0@lo:101: 00000100:00100000:3.0:1788748265.264888:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.264902:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8e141ca going to sleep for 11 seconds 00000100:00100000:3.0:1788748265.264913:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388534912 00000100:00100000:3.0:1788748265.264917:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388534912 00000100:00100000:3.0:1788748265.264933:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788748265.264939:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000233b4eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388534912:12345-0@lo:101: 00010000:00010000:3.0:1788748265.264946:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748265.264953:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f62584aa/0x9ba0f20a02e19c70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19c69 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.264967:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f62584aa/0x9ba0f20a02e19c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.264986:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f62584aa/0x9ba0f20a02e19c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.264992:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f62584aa, rc 0) 00000100:00100000:3.0:1788748265.265034:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000233b4eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388534912:12345-0@lo:101: Request processed in 95us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.265040:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788748265.265085:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388534912:0@lo:101: 00010000:00010000:3.0:1788748265.265094:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.265101:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748265.265146:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388535040:0@lo:501: 00000100:00100000:3.0:1788748265.265182:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.265195:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8e141ca going to sleep for 11 seconds 00000100:00100000:3.0:1788748265.265207:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535040 00000100:00100000:3.0:1788748265.265210:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535040 00000100:00100000:3.0:1788748265.265226:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788748265.265231:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b4ce716b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388535040:12345-0@lo:501: 00000100:00100000:3.0:1788748265.265367:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b4ce716b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388535040:12345-0@lo:501: Request processed in 135us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.265373:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788748265.265400:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388535040:0@lo:501: 00000100:00100000:3.0:1788748265.265422:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388535168:0@lo:503: 00000100:00100000:3.0:1788748265.265461:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.265485:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8e141ca going to sleep for 11 seconds 00000100:00100000:3.0:1788748265.265496:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535168 00000100:00100000:3.0:1788748265.265499:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535168 00000100:00100000:3.0:1788748265.265514:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788748265.265519:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd87d819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388535168:12345-0@lo:503: 00000100:00100000:3.0:1788748265.265594:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd87d819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388535168:12345-0@lo:503: Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.265601:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788748265.265637:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388535168:0@lo:503: 00000100:00100000:3.0:1788748265.265802:0:7815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7815:1875638388535296:0@lo:502: 00000100:00100000:3.0:1788748265.265839:0:7815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.265855:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535296 00000100:00100000:3.0:1788748265.265859:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535296 00000100:00100000:3.0:1788748265.265874:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788748265.265879:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c0b93d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:7815:x1875638388535296:12345-0@lo:502: 00000100:00100000:3.0:1788748265.265944:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c0b93d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:7815:x1875638388535296:12345-0@lo:502: Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.265950:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788748265.265994:0:7815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc000011 going to sleep for 11 seconds 00000100:00100000:3.0:1788748265.266015:0:7815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7815:1875638388535296:0@lo:502: 00000020:01000000:3.0:1788748265.266035:0:7815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748265.266044:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748265.266046:0:7815:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788748265.266051:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788748265.266054:0:7815:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:3.0:1788748265.266073:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748265.266092:0:7815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000eeb299ef) 00000020:00000080:3.0:1788748265.266108:0:7815:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788748265.266114:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788748265.266181:0:7815:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788748265.266186:0:7815:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788748265.266195:0:7815:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19c7e 00010000:00080000:3.0:1788748265.266222:0:7815:0:(ldlm_lib.c:103:import_set_conn()) imp 0000000098f00fc7@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788748265.267842:0:7815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788748265.270296:0:7815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748265.270312:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788748265.270367:0:7815:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788748265.270387:0:7815:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e19c85 00000100:00080000:3.0:1788748265.270396:0:7815:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748265.270405:0:7815:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000098f00fc7 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748265.270437:0:7815:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d40ce6d9 x1875638388535424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748265.270502:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388535424:0@lo:38: 00000100:00100000:0.0:1788748265.270564:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748265.271026:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535424 00000100:00100000:1.0:1788748265.271035:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535424 00000100:00100000:1.0:1788748265.271089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748265.271094:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efa1656e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875638388535424:12345-0@lo:38: 00010000:00080000:1.0:1788748265.271119:0:6515:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1788748265.271151:0:6515:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e19c8c 00000004:00100000:1.0:1788748265.271165:0:6515:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788748265.271170:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788748265.271505:0:7815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788748265.271884:0:7815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:3.0:1788748265.272481:0:7815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748265.272487:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748265.272489:0:7815:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788748265.272492:0:7815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748265.272496:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748265.272497:0:7815:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788748265.272500:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788748265.272501:0:7815:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788748265.272534:0:7815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc01e2ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7815:1875638388535552:0@lo:502: 00000100:00100000:3.0:1788748265.272602:0:7815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.272635:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535552 00000100:00100000:3.0:1788748265.272641:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535552 00000100:00100000:3.0:1788748265.272886:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788748265.272895:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086bd5d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:7815:x1875638388535552:12345-0@lo:502: 00000100:00100000:3.0:1788748265.273257:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086bd5d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:7815:x1875638388535552:12345-0@lo:502: Request processed in 363us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.273265:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788748265.273339:0:7815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1e3701d going to sleep for 11 seconds 00000100:00100000:3.0:1788748265.273359:0:7815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc01e2ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:7815:1875638388535552:0@lo:502: 00000020:01000000:3.0:1788748265.273381:0:7815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748265.273385:0:7815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748265.273387:0:7815:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788748265.273390:0:7815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788748265.273443:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788748265.273460:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788748265.273467:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.273476:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000cde20e7c/0x9ba0f20a02e19c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748265.273485:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788748265.273487:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8add9ea619c0 from 1 10000000:01000000:3.0:1788748265.273490:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788748265.273510:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000011e6b12c/0x9ba0f20a02e19c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.273516:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000011e6b12c/0x9ba0f20a02e19c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.273524:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000011e6b12c/0x9ba0f20a02e19c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748265.273545:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc01e2ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388535680:0@lo:101: 00000100:00100000:3.0:1788748265.273571:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.273591:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1e3701d going to sleep for 11 seconds 00000100:00100000:2.0:1788748265.273866:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388535808:0@lo:400: 00000100:00100000:2.0:1788748265.273896:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.273916:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748265.273921:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0000634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388535936:0@lo:400: 00000100:00100000:2.0:1788748265.273958:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.273981:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b447117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388536064:0@lo:400: 00000100:00100000:2.0:1788748265.274012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.274046:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535808 00000100:00100000:2.0:1788748265.274052:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535808 00000100:00100000:2.0:1788748265.274076:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388536064 00000100:00100000:2.0:1788748265.274078:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388536064 00000100:00100000:2.0:1788748265.274089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748265.274094:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3490d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388535808:12345-0@lo:400: 00000100:00100000:2.0:1788748265.274130:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3490d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388535808:12345-0@lo:400: Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.274136:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748265.274147:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748265.274151:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020954554 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388536064:12345-0@lo:400: 00000100:00100000:2.0:1788748265.274256:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020954554 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388536064:12345-0@lo:400: Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.274262:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748265.274283:0:6516:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788748265.274288:0:6516:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:2.0:1788748265.274384:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003b447117 x1875638388536064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748265.274396:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b447117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388536064:0@lo:400: 00010000:00080000:2.0:1788748265.274416:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006239371c x1875638388535808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748265.274423:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388535808:0@lo:400: 00000100:00100000:2.0:1788748265.274455:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535936 00000100:00100000:2.0:1788748265.274459:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535936 00000100:00100000:2.0:1788748265.274542:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748265.274548:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a127e545 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388535936:12345-0@lo:400: 00000100:00100000:2.0:1788748265.274588:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a127e545 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388535936:12345-0@lo:400: Request processed in 40us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.274599:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748265.274620:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0000634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388535936:0@lo:400: 00000100:00080000:3.0:1788748265.274848:0:7818:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000070238d32 x1875638388536192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748265.274857:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016f25b79 going to sleep for 0 seconds 00000100:00100000:3.0:1788748265.274889:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388535680 00000100:00100000:3.0:1788748265.274893:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388535680 00000100:00100000:3.0:1788748265.274921:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788748265.274938:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa564ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388535680:12345-0@lo:101: 00010000:00010000:3.0:1788748265.274946:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748265.274959:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051ca88a9/0x9ba0f20a02e19c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19c93 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.274979:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051ca88a9/0x9ba0f20a02e19c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.274989:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051ca88a9/0x9ba0f20a02e19c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.275007:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051ca88a9, rc 0) 00000100:00100000:3.0:1788748265.275043:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa564ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388535680:12345-0@lo:101: Request processed in 116us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.275048:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788748265.275080:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc01e2ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388535680:0@lo:101: 00010000:00010000:3.0:1788748265.275091:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000011e6b12c/0x9ba0f20a02e19c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748265.275105:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000011e6b12c/0x9ba0f20a02e19c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748265.275149:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc01e2ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388536320:0@lo:501: 00000100:00100000:3.0:1788748265.275670:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.275706:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1e3701d going to sleep for 11 seconds 00000100:00100000:0.0:1788748265.275817:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388536320 00000100:00100000:0.0:1788748265.275822:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388536320 00000100:00100000:0.0:1788748265.275857:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788748265.275863:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072d38ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388536320:12345-0@lo:501: 00000100:00100000:0.0:1788748265.275959:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072d38ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388536320:12345-0@lo:501: Request processed in 96us (290us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748265.275966:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788748265.276040:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc01e2ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388536320:0@lo:501: 10000000:01000000:1.0:1788748265.276074:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788748265.276080:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000011e6b12c/0x9ba0f20a02e19c93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748265.276088:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000011e6b12c/0x9ba0f20a02e19c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788748265.283728:0:6515:0:(import.c:65:import_set_state_nolock()) 000000004c3524a5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748265.283833:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efa1656e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1875638388535424:12345-0@lo:38: Request processed in 12736us (13267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.283845:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788748265.284426:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748265.284439:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788748265.284448:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788748265.284454:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788748265.284457:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000098f00fc7 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788748265.284486:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000016f25b79): req@0000000070238d32 x1875638388536192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748265.284511:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d40ce6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388535424:0@lo:38: 00000100:00100000:3.0:1788748265.284754:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.284805:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016f25b79 going to sleep for 11 seconds 00000100:00100000:2.0:1788748265.284868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388536192 00000100:00100000:2.0:1788748265.284875:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388536192 00000100:00100000:2.0:1788748265.284926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748265.284935:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004749a7ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388536192:12345-0@lo:1000: 00000100:00100000:2.0:1788748265.285029:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004749a7ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388536192:12345-0@lo:1000: Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748265.285036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748265.285364:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070238d32 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388536192:0@lo:1000: 00000040:01000000:0.0:1788748265.285401:0:7818:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788748265.285443:0:7818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db4f2947 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388536448:0@lo:1000: 00000100:00100000:0.0:1788748265.285488:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748265.285510:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9cb4828 going to sleep for 11 seconds 00000100:00100000:2.0:1788748265.285621:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388536576:0@lo:41: 00000100:00100000:3.0:1788748265.285640:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388536448 00000100:00100000:3.0:1788748265.285646:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388536448 00000100:00100000:2.0:1788748265.285659:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748265.285681:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388536576 00000100:00100000:3.0:1788748265.285685:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388536576 00000100:00100000:3.0:1788748265.285714:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748265.285720:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d9bb61f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7818:x1875638388536448:12345-0@lo:1000: 00000100:00100000:1.0:1788748265.285741:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748265.285752:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0000634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388536576:12345-0@lo:41: 00000004:00000024:1.0:1788748265.285776:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788748265.285829:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0000634 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388536576:12345-0@lo:41: Request processed in 80us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.285836:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748265.285850:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d9bb61f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388536448:12345-0@lo:1000: Request processed in 129us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748265.285858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748265.285917:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388536576:0@lo:41: 00000100:00100000:2.0:1788748265.285940:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db4f2947 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388536448:0@lo:1000: 00000100:00100000:2.0:1788748265.285977:0:7818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388536704:0@lo:700: 00000100:00100000:2.0:1788748265.286013:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.286036:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc98613f going to sleep for 11 seconds 00000100:00100000:1.0:1788748265.286089:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388536704 00000100:00100000:1.0:1788748265.286093:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388536704 00000100:00100000:1.0:1788748265.286126:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748265.286143:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b447117 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388536704:12345-0@lo:700: 00000100:00100000:1.0:1788748265.286189:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b447117 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388536704:12345-0@lo:700: Request processed in 47us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.286197:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748265.288129:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388536704:0@lo:700: 00000100:00100000:2.0:1788748265.288370:0:7818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388536832:0@lo:1000: 00000100:00100000:2.0:1788748265.288421:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.288452:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ee117f0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748265.288561:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388536832 00000100:00100000:1.0:1788748265.288567:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388536832 00000100:00100000:1.0:1788748265.288607:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748265.288614:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024ab3cbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388536832:12345-0@lo:1000: 00000100:00100000:1.0:1788748265.288693:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024ab3cbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388536832:12345-0@lo:1000: Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.288700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748265.288767:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388536832:0@lo:1000: 00000004:00080000:2.0:1788748265.288804:0:7818:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000fc98613f with version 0 00000020:00100000:2.0:1788748265.288816:0:7818:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788748265.288821:0:7818:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006239371c x1875638388537088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748265.288840:0:7818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388537088:0@lo:1000: 00000100:00100000:2.0:1788748265.288863:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.288886:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033f66127 going to sleep for 11 seconds 00000100:00100000:0.0:1788748265.288931:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388537088 00000100:00100000:0.0:1788748265.288935:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388537088 00000100:00100000:0.0:1788748265.288966:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748265.288972:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000741477d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7818:x1875638388537088:12345-0@lo:1000: 00000001:00080000:1.0:1788748265.306511:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788748265.306525:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788748265.306714:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000741477d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7818:x1875638388537088:12345-0@lo:1000: Request processed in 17737us (17846us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788748265.306727:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788748265.306820:0:7818:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788748265.306826:0:7818:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788748265.306839:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388537088:0@lo:1000: 00000100:00100000:2.0:1788748265.306927:0:7818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388537216:0@lo:1000: 00000100:00100000:2.0:1788748265.306963:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748265.307045:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018a442bf going to sleep for 11 seconds 00000100:00100000:1.0:1788748265.307222:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388537216 00000100:00100000:1.0:1788748265.307229:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388537216 00000100:00100000:1.0:1788748265.307274:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788748265.307282:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b0b91de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7818:x1875638388537216:12345-0@lo:1000: 00000100:00100000:1.0:1788748265.307402:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b0b91de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7818:x1875638388537216:12345-0@lo:1000: Request processed in 120us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748265.307408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748265.307564:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006239371c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7818:1875638388537216:0@lo:1000: 00000040:00080000:2.0:1788748265.307581:0:7818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788748265.307610:0:7818:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000fc98613f with version 1 00000004:00080000:1.0:1788748265.309415:0:7816:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000050192a5 version 1 rpc_version 1 00000020:00100000:1.0:1788748265.309457:0:7816:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788748265.309467:0:7816:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000787f7bf1 x1875638388537472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748265.309489:0:7816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000787f7bf1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7816:1875638388537472:0@lo:1000: 00000100:00100000:1.0:1788748265.309548:0:7816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748265.309598:0:7816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eae40461 going to sleep for 11 seconds 00000100:00100000:0.0:1788748265.309667:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388537472 00000100:00100000:0.0:1788748265.309675:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388537472 00000100:00100000:0.0:1788748265.309728:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748265.309736:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000158e4b05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7816:x1875638388537472:12345-0@lo:1000: 00000040:00080000:2.0:1788748265.314772:0:7818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788748265.314861:0:7818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788748265.314866:0:7818:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1788748265.315385:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788748265.315597:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000158e4b05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7816:x1875638388537472:12345-0@lo:1000: Request processed in 5860us (6046us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788748265.315610:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788748265.315705:0:7816:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788748265.315710:0:7816:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788748265.315728:0:7816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000787f7bf1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7816:1875638388537472:0@lo:1000: 00010000:00010000:2.0:1788748265.764620:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788748266.236113:0:7869:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788748266.236513:0:7869:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748266.788578:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788748267.292516:0:7917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeebf39ab0 20000000:00000080:0.0:1788748267.292532:0:7917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8add8f1cd400 uarg=0000000000000000 20000000:01000000:0.0:1788748267.292576:0:7917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788748267.292583:0:7917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788748267.292587:0:7917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788748267.292655:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788748267.292665:0:7917:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788748267.302145:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748267.302576:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788748267.302609:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788748267.302626:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788748267.302642:0:7917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788748267.302661:0:7917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.302680:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.302687:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.302701:0:7917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.303409:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.303427:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 17 pid: 6502 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748267.303442:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001177d0ca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875638388537600:0@lo:104: 00000100:00100000:0.0:1788748267.303510:0:7917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748267.303576:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.303584:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 17 pid: 6503 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748267.303593:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a186cc4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875638388537728:0@lo:104: 00000100:00100000:1.0:1788748267.303604:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788748267.303615:0:7917:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a5b58feb going to sleep for 11 seconds 00000100:00100000:1.0:1788748267.303639:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748267.303668:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388537600 00000100:00100000:1.0:1788748267.303676:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388537600 00000100:00100000:1.0:1788748267.303722:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388537728 00000100:00100000:1.0:1788748267.303726:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388537728 00000100:00100000:1.0:1788748267.303741:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748267.303749:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e06d47a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:7917:x1875638388537600:12345-0@lo:104: 00010000:00010000:1.0:1788748267.303761:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748267.303835:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748267.303840:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e06d47a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:7917:x1875638388537600:12345-0@lo:104: Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748267.303846:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748267.303883:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748267.303889:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000787f7bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:7917:x1875638388537728:12345-0@lo:104: 00010000:00010000:1.0:1788748267.303895:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748267.303933:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748267.303938:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000787f7bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:7917:x1875638388537728:12345-0@lo:104: Request processed in 50us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748267.303944:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748267.303947:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001177d0ca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875638388537600:0@lo:104: 00000100:00100000:0.0:1788748267.303958:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a186cc4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1875638388537728:0@lo:104: 00010000:00010000:1.0:1788748267.303976:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748267.303980:0:7917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748267.303994:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748267.304004:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a44bc99 already unused, calling callback (000000006e8bf550) 10000000:00010000:1.0:1788748267.304007:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748267.304014:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748267.304020:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748267.304026:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748267.304038:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748267.304189:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748267.304194:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304201:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006513beab already unused, calling callback (000000006e8bf550) 10000000:00010000:3.0:1788748267.304204:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304221:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748267.304226:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748267.304230:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788748267.304248:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304254:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748267.304270:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304277:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 000000006513beab/0x9ba0f20a02e19b19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19b20 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304290:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748267.304291:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748267.304293:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748267.304298:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748267.304299:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748267.304330:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886a17f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388537856:0@lo:103: 00000100:00100000:3.0:1788748267.304362:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748267.304394:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388537856 00000100:00100000:3.0:1788748267.304398:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388537856 00010000:00010000:3.0:1788748267.304414:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 18 pid: 6503 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748267.304440:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748267.304451:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bb3b425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3635:x1875638388537856:12345-0@lo:103: 00010000:00010000:3.0:1788748267.304461:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748267.304465:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 18 pid: 6503 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304472:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 18 pid: 6503 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304483:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19b20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19b19 expref: 18 pid: 6503 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304493:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748267.304519:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bb3b425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3635:x1875638388537856:12345-0@lo:103: Request processed in 69us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1788748267.304521:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748267.304526:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788748267.304538:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748267.304547:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748267.304550:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886a17f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388537856:0@lo:103: 00000100:00100000:3.0:1788748267.304562:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748267.304569:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388537984:0@lo:103: 00010000:00010000:1.0:1788748267.304577:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 000000001a44bc99/0x9ba0f20a02e19c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c0e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748267.304594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748267.304595:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748267.304598:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748267.304600:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748267.304640:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388537984 00000100:00100000:3.0:1788748267.304644:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388537984 00010000:00010000:3.0:1788748267.304654:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 17 pid: 6502 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748267.304682:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748267.304687:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000886a17f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3635:x1875638388537984:12345-0@lo:103: 00010000:00010000:3.0:1788748267.304694:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748267.304697:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 17 pid: 6502 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304712:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 17 pid: 6502 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304721:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040cac1c2/0x9ba0f20a02e19c0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19c07 expref: 17 pid: 6502 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304745:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304752:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304763:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304770:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304775:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304781:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304785:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004bcebaa1 already unused, calling callback (000000002d9bebd3) 00010000:00010000:3.0:1788748267.304788:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304794:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304813:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.304821:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748267.304859:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000886a17f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:3635:x1875638388537984:12345-0@lo:103: Request processed in 172us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748267.304866:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748267.304917:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388537984:0@lo:103: 00010000:00010000:0.0:1788748267.305026:0:7917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.305032:0:7917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748267.305044:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004bcebaa1/0x9ba0f20a02e19ca1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748267.812669:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748268.329017:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748268.329042:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388538112:0@lo:41: 00000100:00100000:2.0:1788748268.329110:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748268.329207:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388538112 00000100:00100000:1.0:1788748268.329216:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388538112 00000100:00100000:1.0:1788748268.329272:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748268.329280:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006239371c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388538112:12345-0@lo:41: 00000004:00000024:1.0:1788748268.329332:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788748268.329381:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006239371c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388538112:12345-0@lo:41: Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748268.329388:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788748268.329514:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ea1df64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388538112:0@lo:41: 00010000:00010000:0.0:1788748268.837406:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748269.867600:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748270.376430:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000202649b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388538240:0@lo:400: 00000100:00100000:2.0:1788748270.376553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748270.376614:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b4f3436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388538752:0@lo:400: 00000100:00100000:2.0:1788748270.376645:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748270.376706:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748270.376712:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da046a05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388538624:0@lo:400: 00000100:00100000:2.0:1788748270.376760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748270.376807:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388538624 00000100:00100000:2.0:1788748270.376817:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388538624 00000100:00100000:2.0:1788748270.376880:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748270.376890:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0099364 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388538624:12345-0@lo:400: 00000100:00100000:2.0:1788748270.376952:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0099364 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388538624:12345-0@lo:400: Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748270.376960:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788748270.377019:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000da046a05 x1875638388538624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748270.377036:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da046a05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388538624:0@lo:400: 00000100:00100000:1.0:1788748270.377224:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388538368:0@lo:400: 00000100:00100000:1.0:1788748270.377258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.377288:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388538880:0@lo:41: 00000100:00100000:1.0:1788748270.377312:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.377351:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748270.377358:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6b3e333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388538496:0@lo:400: 00000100:00100000:1.0:1788748270.377380:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748270.377411:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388538240 00000100:00100000:1.0:1788748270.377415:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388538240 00000100:00100000:1.0:1788748270.377449:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788748270.377457:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c9cd7e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:3638:x1875638388538240:12345-0@lo:400: 00000100:00100000:1.0:1788748270.377510:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c9cd7e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:3638:x1875638388538240:12345-0@lo:400: Request processed in 54us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.377517:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788748270.377550:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388538752 00000100:00100000:1.0:1788748270.377554:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388538752 00000100:00100000:1.0:1788748270.377570:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388538880 00000100:00100000:1.0:1788748270.377572:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388538880 00000100:00100000:1.0:1788748270.377582:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388538496 00000100:00100000:1.0:1788748270.377584:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388538496 00000100:00100000:1.0:1788748270.377596:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788748270.377601:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000572fbc6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388538752:12345-0@lo:400: 00000100:00100000:1.0:1788748270.377650:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000572fbc6f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388538752:12345-0@lo:400: Request processed in 50us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.377657:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788748270.377670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788748270.377675:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ca8bfb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388538880:12345-0@lo:41: 00000004:00000024:1.0:1788748270.377703:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788748270.377737:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ca8bfb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388538880:12345-0@lo:41: Request processed in 62us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.377743:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788748270.377755:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788748270.377761:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000784a9637 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388538496:12345-0@lo:400: 00000100:00100000:1.0:1788748270.377788:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000784a9637 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388538496:12345-0@lo:400: Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748270.377794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788748270.377825:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6b3e333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388538496:0@lo:400: 00000100:00100000:1.0:1788748270.377839:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388538880:0@lo:41: 00000100:00100000:1.0:1788748270.377880:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000202649b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388538240:0@lo:400: 00000100:00100000:1.0:1788748270.377888:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b4f3436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388538752:0@lo:400: 00000100:00100000:2.0:1788748270.378064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388538368 00000100:00100000:2.0:1788748270.378070:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388538368 00000100:00100000:2.0:1788748270.378110:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748270.378116:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f72d232b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388538368:12345-0@lo:400: 00000100:00100000:2.0:1788748270.378158:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f72d232b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388538368:12345-0@lo:400: Request processed in 43us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748270.378164:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788748270.378225:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e44fa7ae x1875638388538368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748270.378237:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e44fa7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388538368:0@lo:400: 00010000:00010000:3.0:1788748270.884700:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748271.908514:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788748271.908671:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748271.908677:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add8f106000 from 1 10000000:01000000:1.0:1788748271.908684:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748271.908769:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000b87f690c/0x9ba0f20a02e19ca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748271.908783:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000b87f690c/0x9ba0f20a02e19ca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748271.908796:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000b87f690c/0x9ba0f20a02e19ca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748271.908826:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539008:0@lo:101: 00000100:00100000:1.0:1788748271.908913:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748271.908998:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017f7fb19 going to sleep for 11 seconds 00000100:00100000:3.0:1788748271.909053:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539008 00000100:00100000:3.0:1788748271.909066:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539008 00000100:00100000:3.0:1788748271.909149:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748271.909160:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a5195dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388539008:12345-0@lo:101: 00010000:00010000:3.0:1788748271.909176:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748271.909192:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19caf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19ca8 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748271.909221:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748271.909232:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035fdaf4e/0x9ba0f20a02e19caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748271.909242:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035fdaf4e, rc 0) 00000100:00100000:3.0:1788748271.909305:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a5195dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388539008:12345-0@lo:101: Request processed in 146us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748271.909311:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788748271.909657:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539008:0@lo:101: 00010000:00010000:1.0:1788748271.909677:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000b87f690c/0x9ba0f20a02e19ca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748271.909686:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000b87f690c/0x9ba0f20a02e19ca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748271.909761:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539136:0@lo:501: 00000100:00100000:1.0:1788748271.909794:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748271.909832:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017f7fb19 going to sleep for 11 seconds 00000100:00100000:0.0:1788748271.909907:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539136 00000100:00100000:0.0:1788748271.909914:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539136 00000100:00100000:0.0:1788748271.909963:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748271.909970:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004145b813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388539136:12345-0@lo:501: 00000100:00100000:0.0:1788748271.910106:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004145b813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388539136:12345-0@lo:501: Request processed in 136us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.910114:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788748271.910726:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539136:0@lo:501: 00000100:00100000:1.0:1788748271.910792:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539264:0@lo:503: 00000100:00100000:1.0:1788748271.910854:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748271.910889:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017f7fb19 going to sleep for 11 seconds 00000100:00100000:3.0:1788748271.911073:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539264 00000100:00100000:3.0:1788748271.911086:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539264 00000100:00100000:3.0:1788748271.911128:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748271.911136:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020587e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388539264:12345-0@lo:503: 00000100:00100000:3.0:1788748271.911260:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020587e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388539264:12345-0@lo:503: Request processed in 125us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748271.911267:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788748271.911364:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044fd40fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539264:0@lo:503: 00000100:00100000:3.0:1788748271.911743:0:8145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079aa5fe7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8145:1875638388539392:0@lo:502: 00000100:00100000:3.0:1788748271.911782:0:8145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748271.911817:0:8145:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a099bd67 going to sleep for 11 seconds 00000100:00100000:2.0:1788748271.911863:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539392 00000100:00100000:2.0:1788748271.911869:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539392 00000100:00100000:2.0:1788748271.911903:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788748271.911909:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bac82475 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8145:x1875638388539392:12345-0@lo:502: 00000100:00100000:2.0:1788748271.912013:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bac82475 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8145:x1875638388539392:12345-0@lo:502: Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748271.912020:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748271.912120:0:8145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079aa5fe7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8145:1875638388539392:0@lo:502: 00000020:01000000:0.0:1788748271.912144:0:8145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748271.912156:0:8145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748271.912159:0:8145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788748271.912169:0:8145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8add8f106000 00000020:00000080:0.0:1788748271.912172:0:8145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788748271.912217:0:8145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8145:1875638388539520:0@lo:502: 00000100:00100000:0.0:1788748271.912250:0:8145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748271.912375:0:8145:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25480 going to sleep for 11 seconds 00000100:00100000:1.0:1788748271.919671:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539520 00000100:00100000:1.0:1788748271.919719:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539520 00000100:00100000:0.0:1788748271.921123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788748271.921139:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8145:x1875638388539520:12345-0@lo:502: 00000100:00100000:0.0:1788748271.921403:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8145:x1875638388539520:12345-0@lo:502: Request processed in 267us (9151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.921422:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788748271.921704:0:8145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8145:1875638388539520:0@lo:502: 00000020:01000000:1.0:1788748271.921747:0:8145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748271.921756:0:8145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748271.921759:0:8145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788748271.921765:0:8145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788748271.921977:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788748271.922007:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748271.922020:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748271.922032:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748271.922045:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748271.922048:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adda7357000 from 1 10000000:01000000:2.0:1788748271.922051:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748271.922092:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748271.922101:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748271.922112:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748271.922134:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539648:0@lo:101: 00000100:00100000:2.0:1788748271.922181:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748271.922234:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9e6e3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748271.922288:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539648 00000100:00100000:0.0:1788748271.922296:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539648 00000100:00100000:0.0:1788748271.922517:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748271.922528:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388539648:12345-0@lo:101: 00010000:00010000:0.0:1788748271.922541:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748271.922561:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19cb6 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748271.922590:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748271.922601:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748271.922610:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a400, rc 0) 00000100:00100000:0.0:1788748271.922657:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388539648:12345-0@lo:101: Request processed in 131us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.922663:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788748271.922730:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539648:0@lo:101: 00010000:00010000:2.0:1788748271.922744:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748271.922753:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748271.922807:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539776:0@lo:501: 00000100:00100000:2.0:1788748271.922844:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748271.922936:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9e6e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788748271.923004:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539776 00000100:00100000:1.0:1788748271.923010:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539776 00000100:00100000:1.0:1788748271.923034:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788748271.923040:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388539776:12345-0@lo:501: 00000100:00100000:1.0:1788748271.923167:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388539776:12345-0@lo:501: Request processed in 127us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748271.923174:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788748271.923242:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539776:0@lo:501: 00000100:00100000:2.0:1788748271.923269:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539904:0@lo:503: 00000100:00100000:2.0:1788748271.923307:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748271.923353:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9e6e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788748271.923473:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388539904 00000100:00100000:1.0:1788748271.923478:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388539904 00000100:00100000:1.0:1788748271.923493:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788748271.923498:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388539904:12345-0@lo:503: 00000100:00100000:1.0:1788748271.923585:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388539904:12345-0@lo:503: Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748271.923592:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788748271.923671:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388539904:0@lo:503: 00000100:00100000:2.0:1788748271.924029:0:8146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8146:1875638388540032:0@lo:502: 00000100:00100000:2.0:1788748271.924069:0:8146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748271.924102:0:8146:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8860fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748271.924179:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540032 00000100:00100000:0.0:1788748271.924184:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540032 00000100:00100000:0.0:1788748271.924209:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748271.924216:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8146:x1875638388540032:12345-0@lo:502: 00000100:00100000:0.0:1788748271.924301:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8146:x1875638388540032:12345-0@lo:502: Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.924308:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788748271.924428:0:8146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8146:1875638388540032:0@lo:502: 00000020:01000000:2.0:1788748271.924454:0:8146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748271.924466:0:8146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748271.924468:0:8146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788748271.924476:0:8146:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adda7357000 00000020:00000080:2.0:1788748271.924479:0:8146:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788748271.924502:0:8146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8146:1875638388540160:0@lo:502: 00000100:00100000:2.0:1788748271.924538:0:8146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748271.924554:0:8146:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9e6e3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748271.924632:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540160 00000100:00100000:0.0:1788748271.924637:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540160 00000100:00100000:0.0:1788748271.924659:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788748271.924664:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8146:x1875638388540160:12345-0@lo:502: 00000100:00100000:0.0:1788748271.924724:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8146:x1875638388540160:12345-0@lo:502: Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748271.924730:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788748271.924828:0:8146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8146:1875638388540160:0@lo:502: 00000020:01000000:2.0:1788748271.924846:0:8146:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748271.924850:0:8146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748271.924851:0:8146:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788748271.924855:0:8146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788748271.925226:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788748271.925247:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748271.925257:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748271.925270:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748272.934565:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748273.444552:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748273.444581:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388540288:0@lo:41: 00000100:00100000:1.0:1788748273.444641:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748273.444782:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540288 00000100:00100000:1.0:1788748273.444790:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540288 00000100:00100000:1.0:1788748273.444832:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788748273.444840:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388540288:12345-0@lo:41: 00000004:00000024:1.0:1788748273.444874:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788748273.445439:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388540288:12345-0@lo:41: Request processed in 596us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748273.445448:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748273.445568:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388540288:0@lo:41: 00010000:00010000:0.0:1788748273.958686:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748274.982450:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748275.496399:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388540416:0@lo:41: 00000100:00100000:2.0:1788748275.496485:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.496665:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540416 00000100:00100000:1.0:1788748275.496673:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540416 00000100:00100000:1.0:1788748275.496724:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788748275.496733:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388540416:12345-0@lo:41: 00000004:00000024:1.0:1788748275.496763:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788748275.496801:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388540416:12345-0@lo:41: Request processed in 69us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.496807:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788748275.496829:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388540672:0@lo:400: 00000100:00100000:1.0:1788748275.496852:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.496869:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748275.496874:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388540800:0@lo:400: 00000100:00100000:1.0:1788748275.496890:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748275.496910:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540800 00000100:00100000:1.0:1788748275.496913:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540800 00000100:00100000:1.0:1788748275.496942:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788748275.496948:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388540800:12345-0@lo:400: 00000100:00100000:1.0:1788748275.496978:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388540800:12345-0@lo:400: Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.496984:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788748275.497003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540672 00000100:00100000:1.0:1788748275.497006:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540672 00000100:00100000:1.0:1788748275.497025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748275.497031:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388540672:12345-0@lo:400: 00000100:00100000:1.0:1788748275.497054:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388540672:12345-0@lo:400: Request processed in 23us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.497065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748275.497103:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388540800:0@lo:400: 00010000:00080000:1.0:1788748275.497115:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8add8f163800 x1875638388540672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748275.497125:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388540672:0@lo:400: 00000100:00100000:2.0:1788748275.497282:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388540928:0@lo:400: 00000100:00100000:2.0:1788748275.497306:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.497359:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388540416:0@lo:41: 00000100:00100000:2.0:1788748275.497369:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748275.497374:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388540544:0@lo:400: 00000100:00100000:2.0:1788748275.497396:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748275.497425:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540544 00000100:00100000:2.0:1788748275.497428:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540544 00000100:00100000:2.0:1788748275.497450:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788748275.497456:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3637:x1875638388540544:12345-0@lo:400: 00000100:00100000:2.0:1788748275.497487:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3637:x1875638388540544:12345-0@lo:400: Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748275.497493:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788748275.497522:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388540544:0@lo:400: 00000100:00100000:1.0:1788748275.498077:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388540928 00000100:00100000:1.0:1788748275.498082:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388540928 00000100:00100000:1.0:1788748275.498116:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748275.498123:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388540928:12345-0@lo:400: 00000100:00100000:1.0:1788748275.498183:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388540928:12345-0@lo:400: Request processed in 61us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748275.498189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788748275.498348:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8add8f160e00 x1875638388540928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748275.498362:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388540928:0@lo:400: 00010000:00010000:1.0:1788748276.004490:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788748276.733405:0:8418:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788748276.733410:0:8418:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788748276.733412:0:8418:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788748276.734808:0:8418:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8addb53d9000 00000020:01000004:0.0:1788748276.734827:0:8418:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788748276.734840:0:8418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788748276.734855:0:8418:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8addb39399c0) 00000020:00000080:0.0:1788748276.734871:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788748276.790932:0:8418:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788748276.790992:0:8418:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788748276.807568:0:8418:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788748276.807818:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788748276.807830:0:8418:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788748276.807840:0:8418:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9ba0f20a02e19ccb 00000020:01000004:2.0:1788748276.807847:0:8418:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788748276.807869:0:8418:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788748276.807873:0:8418:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788748276.807879:0:8418:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788748276.807883:0:8418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788748276.807894:0:8418:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8add9ea64d40) 00000020:00000080:2.0:1788748276.807904:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788748276.809483:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748276.809776:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788748276.809788:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788748276.811446:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788748276.811461:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788748276.815717:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788748276.815727:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788748276.821993:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748276.822183:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788748276.822190:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788748276.823081:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788748276.823089:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788748276.848293:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748276.848825:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788748276.848833:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788748276.850151:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788748276.850164:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788748276.852224:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788748276.852236:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788748276.855404:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748276.855738:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788748276.855745:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788748276.856572:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788748276.856582:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788748276.897287:0:8418:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748276.897936:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788748276.897944:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788748276.903146:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788748276.903163:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788748276.905138:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788748276.905168:0:8418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788748276.905173:0:8418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788748276.921933:0:8418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788748276.921972:0:8418:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788748276.921977:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788748276.921978:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788748276.921980:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748276.921981:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748276.921982:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748276.921985:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748276.921986:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748276.921988:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748276.921994:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748276.921996:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748276.921998:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748276.922001:0:8418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788748276.922004:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748276.922005:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788748276.922006:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748276.922007:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748276.922008:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748276.922009:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748276.922010:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748276.922011:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748276.922012:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748276.922013:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748276.922014:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748276.922042:0:8418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788748276.922062:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388541056:0@lo:253: 00000100:00100000:3.0:1788748276.922132:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.922262:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748276.922711:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541056 00000100:00100000:2.0:1788748276.922720:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541056 00000100:00100000:2.0:1788748276.922802:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748276.922811:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8418:x1875638388541056:12345-0@lo:253: 20000000:01000000:2.0:1788748276.922851:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788748276.922855:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788748276.922859:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788748276.922862:0:6504:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788748276.923068:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748276.923214:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788748276.923230:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788748276.923248:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788748276.923254:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788748276.923267:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788748276.923281:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788748276.923393:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788748276.923409:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:2.0:1788748276.923411:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:2.0:1788748276.923426:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788748276.923433:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788748276.923465:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788748276.923472:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:2.0:1788748276.923485:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788748276.923491:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788748276.923520:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788748276.923538:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788748276.923619:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788748276.923631:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:2.0:1788748276.923645:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:2.0:1788748276.923674:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788748276.923682:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788748276.923695:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788748276.923701:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:2.0:1788748276.923714:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788748276.923721:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788748276.923733:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788748276.923749:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788748276.924110:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788748276.924122:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:2.0:1788748276.924124:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:2.0:1788748276.924139:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788748276.924145:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788748276.924158:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788748276.924164:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:2.0:1788748276.924176:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788748276.924182:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788748276.924193:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788748276.924206:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788748276.924219:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788748276.924221:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788748276.924231:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788748276.924275:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788748276.924277:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788748276.925139:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788748276.925171:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788748276.925187:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788748276.925477:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788748276.925620:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788748276.925639:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788748276.925729:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788748276.925731:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788748276.926083:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788748276.926109:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788748276.926125:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788748276.926289:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788748276.926308:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788748276.926631:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788748276.926719:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788748276.926721:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788748276.927027:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788748276.927050:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788748276.927086:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788748276.927978:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788748276.928005:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788748276.928039:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788748276.928051:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788748276.928053:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788748276.928506:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788748276.928839:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788748276.928863:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788748276.928877:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1788748276.928894:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788748276.928913:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.928943:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add839f7800/0x9ba0f20a02e19ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.928952:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add80030600/0x9ba0f20a02e19c1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.928959:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e19c54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.928966:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e19c70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.928972:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.928979:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.929016:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.929039:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 18 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.929053:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541184:0@lo:104: 00000100:00100000:2.0:1788748276.929118:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748276.929180:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e19c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.929189:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e19c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 18 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.929197:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541312:0@lo:104: 00000100:00100000:2.0:1788748276.929217:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748276.929247:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e19c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.929254:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e19c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 18 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.929262:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541440:0@lo:104: 00000100:00100000:2.0:1788748276.929281:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748276.929296:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add80030600/0x9ba0f20a02e19c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.929303:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8add80030600/0x9ba0f20a02e19c1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 18 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.929311:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541568:0@lo:104: 00000100:00100000:2.0:1788748276.929374:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748276.929398:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add839f7800/0x9ba0f20a02e19ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.929406:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8add839f7800/0x9ba0f20a02e19ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 18 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.929414:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541696:0@lo:104: 00000100:00100000:2.0:1788748276.929435:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748276.929446:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748276.929531:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541184 00000100:00100000:1.0:1788748276.929540:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541184 00000100:00100000:1.0:1788748276.929583:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541312 00000100:00100000:1.0:1788748276.929586:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541312 00000100:00100000:1.0:1788748276.929595:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541440 00000100:00100000:1.0:1788748276.929597:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541440 00000100:00100000:1.0:1788748276.929617:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541568 00000100:00100000:1.0:1788748276.929620:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541568 00000100:00100000:1.0:1788748276.929627:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541696 00000100:00100000:1.0:1788748276.929629:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541696 00000100:00100000:3.0:1788748276.930491:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748276.930517:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+7:6504:x1875638388541184:12345-0@lo:104: 00010000:00010000:3.0:1788748276.930534:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.930623:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748276.930629:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+7:6504:x1875638388541184:12345-0@lo:104: Request processed in 118us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.930635:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748276.930657:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748276.930664:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:6504:x1875638388541312:12345-0@lo:104: 00010000:00010000:3.0:1788748276.930671:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.930705:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788748276.930710:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:6504:x1875638388541312:12345-0@lo:104: Request processed in 48us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.930715:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748276.930727:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748276.930733:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6504:x1875638388541440:12345-0@lo:104: 00010000:00010000:3.0:1788748276.930741:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.930777:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788748276.930782:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6504:x1875638388541440:12345-0@lo:104: Request processed in 49us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.930787:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748276.930800:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748276.930813:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6504:x1875638388541568:12345-0@lo:104: 00010000:00010000:3.0:1788748276.930821:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.930847:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788748276.930852:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6504:x1875638388541568:12345-0@lo:104: Request processed in 41us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.930857:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748276.931119:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541184:0@lo:104: 00000100:00100000:2.0:1788748276.931130:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541312:0@lo:104: 00000100:00100000:2.0:1788748276.931137:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541440:0@lo:104: 00000100:00100000:2.0:1788748276.931143:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541568:0@lo:104: 00000100:00100000:1.0:1788748276.932143:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748276.932156:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6504:x1875638388541696:12345-0@lo:104: 00010000:00010000:1.0:1788748276.932167:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932276:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788748276.932282:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6504:x1875638388541696:12345-0@lo:104: Request processed in 131us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.932289:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788748276.932311:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788748276.932331:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932338:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748276.932343:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932351:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748276.932358:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748276.932363:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748276.932401:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932418:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748276.932438:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932445:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19c93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932459:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788748276.932462:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932468:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748276.932470:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932477:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748276.932483:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748276.932488:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748276.932514:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932520:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748276.932533:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932539:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e19c69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932566:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748276.932569:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932575:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add80031a00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748276.932578:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932584:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748276.932589:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748276.932594:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748276.932606:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932612:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748276.932617:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932623:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add80031a00/0x9ba0f20a02e19c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c54 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932641:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748276.932645:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932661:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fb400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748276.932664:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932670:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748276.932676:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748276.932680:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748276.932693:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932699:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748276.932704:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932709:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813fb400/0x9ba0f20a02e19c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c1c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932719:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748276.932722:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932727:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813faa00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748276.932729:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932745:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748276.932751:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748276.932755:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748276.932766:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932771:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748276.932775:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932781:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ba5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.932792:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748276.932794:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748276.932795:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748276.932816:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388541824:0@lo:103: 00000100:00100000:1.0:1788748276.932852:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.932886:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388542336:0@lo:103: 00000100:00100000:1.0:1788748276.932903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.932931:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748276.932937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388542208:0@lo:103: 00000100:00100000:1.0:1788748276.932964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.932993:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388541952:0@lo:103: 00000100:00100000:1.0:1788748276.933029:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.933045:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748276.933051:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388542080:0@lo:103: 00010000:00010000:0.0:1788748276.933053:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748276.933062:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748276.933076:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.933103:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541824 00000100:00100000:1.0:1788748276.933109:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541824 00010000:00010000:1.0:1788748276.933129:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 19 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.933149:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542336 00000100:00100000:1.0:1788748276.933151:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542336 00010000:00010000:1.0:1788748276.933161:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add839f7800/0x9ba0f20a02e19ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 20 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.933171:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542208 00000100:00100000:1.0:1788748276.933173:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542208 00010000:00010000:1.0:1788748276.933182:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add80030600/0x9ba0f20a02e19c1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 21 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.933190:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388541952 00000100:00100000:1.0:1788748276.933193:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388541952 00010000:00010000:1.0:1788748276.933201:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e19c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 22 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.933209:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542080 00000100:00100000:1.0:1788748276.933211:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542080 00010000:00010000:1.0:1788748276.933219:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e19c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 23 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.933230:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748276.933237:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:3638:x1875638388541824:12345-0@lo:103: 00010000:00010000:1.0:1788748276.933256:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748276.933261:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 23 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933270:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 23 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933284:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19c9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19c93 expref: 23 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933298:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748276.933348:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3638:x1875638388541824:12345-0@lo:103: Request processed in 112us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.933355:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748276.933370:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748276.933376:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3638:x1875638388542336:12345-0@lo:103: 00010000:00010000:1.0:1788748276.933383:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748276.933387:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add839f7800/0x9ba0f20a02e19ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 21 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933395:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add839f7800/0x9ba0f20a02e19ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 21 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933405:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748276.933425:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3638:x1875638388542336:12345-0@lo:103: Request processed in 50us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.933433:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748276.933448:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748276.933457:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:3638:x1875638388542208:12345-0@lo:103: 00010000:00010000:1.0:1788748276.933472:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748276.933477:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add80030600/0x9ba0f20a02e19c1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 20 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933484:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add80030600/0x9ba0f20a02e19c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 20 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748276.933493:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388541824:0@lo:103: 00010000:00010000:1.0:1788748276.933496:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add80030600/0x9ba0f20a02e19c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19c15 expref: 20 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933509:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748276.933509:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388542336:0@lo:103: 00000100:00100000:1.0:1788748276.933540:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:3638:x1875638388542208:12345-0@lo:103: Request processed in 85us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748276.933545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388542208:0@lo:103: 00000100:00100000:1.0:1788748276.933551:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748276.933568:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748276.933576:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3635:x1875638388541952:12345-0@lo:103: 00010000:00010000:1.0:1788748276.933594:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748276.933599:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e19c70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 18 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933606:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e19c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 18 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933615:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e19c70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19c69 expref: 18 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933625:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748276.933664:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3635:x1875638388541952:12345-0@lo:103: Request processed in 90us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.933670:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748276.933689:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748276.933695:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add88431850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:3635:x1875638388542080:12345-0@lo:103: 00010000:00010000:1.0:1788748276.933702:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748276.933706:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e19c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 16 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933714:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e19c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 16 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933724:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e19c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19c4d expref: 16 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933733:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933741:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933755:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933761:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933766:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933772:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933777:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748276.933780:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933793:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933801:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.933811:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748276.933833:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add88431850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3635:x1875638388542080:12345-0@lo:103: Request processed in 139us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.933839:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748276.934146:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388542080:0@lo:103: 00000100:00100000:0.0:1788748276.934155:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388541952:0@lo:103: 00010000:00010000:2.0:1788748276.934252:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f7800/0x9ba0f20a02e19ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19b9e expref: 14 pid: 6504 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.934265:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6504:1875638388541696:0@lo:104: 00010000:00010000:2.0:1788748276.934288:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.934297:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.934303:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.934310:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cd9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748276.934475:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788748276.936883:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:8418:x1875638388541056:12345-0@lo:253: Request processed in 14064us (14742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.936896:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748276.936988:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388541056:0@lo:253: 10000000:01000000:2.0:1788748276.937004:0:8418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788748276.937008:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748276.937010:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748276.937011:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748276.937013:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788748276.937014:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748276.937015:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748276.937017:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748276.937019:0:8418:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788748276.937021:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748276.937022:0:8418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788748276.937042:0:8418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8addb53d9000 from lustre-OST0000 10000000:01000000:2.0:1788748276.937075:0:8418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788748276.937078:0:8418:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788748276.937087:0:8418:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8add9ea619c0 local copy 10000000:01000000:2.0:1788748276.937091:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788748276.937127:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.937138:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.937147:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.937164:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542464:0@lo:101: 00000100:00100000:2.0:1788748276.937200:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748276.937278:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748276.937416:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542464 00000100:00100000:1.0:1788748276.937423:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542464 00000100:00100000:1.0:1788748276.937509:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788748276.937519:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+13:8418:x1875638388542464:12345-0@lo:101: 00010000:00010000:1.0:1788748276.937532:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748276.937546:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19ce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19ce0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.937804:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ce0 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.937817:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ce0 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.937825:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813fac00, rc 0) 00000100:00100000:1.0:1788748276.937912:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388542464:12345-0@lo:101: Request processed in 395us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.937929:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788748276.937998:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542464:0@lo:101: 00010000:00010000:3.0:1788748276.938013:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.938021:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748276.938112:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542592:0@lo:501: 00000100:00100000:3.0:1788748276.938140:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.938256:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eac2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748276.938406:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542592 00000100:00100000:2.0:1788748276.938419:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542592 00000100:00100000:2.0:1788748276.938443:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788748276.938450:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388542592:12345-0@lo:501: 00000100:00100000:2.0:1788748276.938523:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388542592:12345-0@lo:501: Request processed in 72us (382us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748276.938530:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788748276.939077:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542592:0@lo:501: 10000000:01000000:3.0:1788748276.939093:0:8418:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788748276.939113:0:8418:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788748276.939118:0:8418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.939138:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.939145:0:8418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.939202:0:8418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788748276.939226:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8addb53d9000 10000000:01000000:3.0:1788748276.939231:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788748276.939236:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788748276.939238:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748276.939242:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788748276.939245:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788748276.939265:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.939272:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.939280:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748276.939292:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542720:0@lo:101: 00000100:00100000:3.0:1788748276.939397:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.939454:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6a5d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788748276.939538:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748276.939545:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.939872:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748276.939876:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.939885:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748276.939892:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748276.939897:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748276.939918:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.939951:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788748276.939992:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388542848:0@lo:103: 00000100:00100000:0.0:1788748276.940030:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748276.940080:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.940088:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19ce7 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.940101:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748276.940103:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748276.940105:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748276.940156:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542848 00000100:00100000:3.0:1788748276.940163:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542848 00000100:00100000:3.0:1788748276.940212:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748276.940221:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:3635:x1875638388542848:12345-0@lo:103: 00010000:00010000:3.0:1788748276.940242:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748276.940257:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19ce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19ce0 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.940272:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748276.940479:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542720 00000100:00100000:2.0:1788748276.940484:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542720 00000100:00100000:2.0:1788748276.940519:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788748276.940526:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388542720:12345-0@lo:101: 00010000:00010000:2.0:1788748276.940537:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748276.940548:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19cee expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.940579:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.940589:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.940596:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6200, rc 0) 00000100:00100000:2.0:1788748276.940862:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388542720:12345-0@lo:101: Request processed in 335us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748276.940868:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788748276.940957:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542720:0@lo:101: 00010000:00010000:1.0:1788748276.940970:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.940992:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.941087:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542976:0@lo:501: 00000100:00100000:1.0:1788748276.941117:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.941154:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748276.941206:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388542976 00000100:00100000:2.0:1788748276.941211:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388542976 00000100:00100000:2.0:1788748276.941241:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788748276.941248:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388542976:12345-0@lo:501: 00000100:00100000:2.0:1788748276.941363:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388542976:12345-0@lo:501: Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748276.941377:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788748276.941507:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388542976:0@lo:501: 00000100:00100000:1.0:1788748276.941773:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543104:0@lo:503: 00000100:00100000:0.0:1788748276.941831:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388542848:0@lo:103: 00000100:00100000:3.0:1788748276.941848:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:3635:x1875638388542848:12345-0@lo:103: Request processed in 1612us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.941858:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748276.941943:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.942010:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748276.942042:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388543104 00000100:00100000:2.0:1788748276.942046:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388543104 00000100:00100000:2.0:1788748276.942097:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788748276.942103:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388543104:12345-0@lo:503: 00000100:00100000:2.0:1788748276.942189:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388543104:12345-0@lo:503: Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748276.942195:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788748276.942261:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543104:0@lo:503: 00000040:00080000:3.0:1788748276.942736:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748276.942820:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543232:0@lo:502: 00000100:00100000:3.0:1788748276.942858:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.943016:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6a5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788748276.943096:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388543232 00000100:00100000:1.0:1788748276.943103:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388543232 00000100:00100000:1.0:1788748276.943131:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788748276.943138:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388543232:12345-0@lo:502: 00000100:00100000:1.0:1788748276.943244:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388543232:12345-0@lo:502: Request processed in 106us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.943251:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788748276.943358:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543232:0@lo:502: 00000040:00080000:3.0:1788748276.943580:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788748276.943608:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788748276.943630:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788748276.943648:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788748276.943659:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788748276.943669:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788748276.943686:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543360:0@lo:502: 00000100:00100000:3.0:1788748276.943714:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.943739:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6a5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788748276.943944:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388543360 00000100:00100000:1.0:1788748276.943949:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388543360 00000100:00100000:1.0:1788748276.943966:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788748276.943971:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388543360:12345-0@lo:502: 00000100:00100000:1.0:1788748276.944036:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388543360:12345-0@lo:502: Request processed in 64us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.944042:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788748276.944100:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543360:0@lo:502: 00000040:00080000:3.0:1788748276.944131:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788748276.944137:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788748276.944519:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788748276.944531:0:8441:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788748276.944537:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748276.944539:0:8441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788748276.944544:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748276.944741:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8adc825d4d40) 00000020:00000080:3.0:1788748276.944762:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788748276.944769:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788748276.944831:0:8441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8addb53d9000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788748276.944839:0:8441:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788748276.944846:0:8441:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9ba0f20a02e19d03 00010000:00010000:3.0:1788748276.949217:0:8441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788748276.950349:0:8441:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788748276.953244:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788748276.953689:0:8441:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788748276.956143:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788748276.956290:0:8441:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788748276.961812:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788748276.964245:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788748276.964263:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748276.964269:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748276.964272:0:8441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788748276.964276:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748276.964280:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748276.964282:0:8441:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748276.964284:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748276.964286:0:8441:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788748276.964313:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748276.968638:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748276.968643:0:8441:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788748276.968650:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788748276.968991:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788748276.969023:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788748276.969045:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.969057:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748276.969065:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8addb53d9000 from 1 10000000:01000000:2.0:1788748276.969067:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748276.969102:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.969109:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748276.969119:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748276.969153:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543488:0@lo:101: 00000100:00100000:2.0:1788748276.969234:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748276.969285:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748276.969427:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388543488 00000100:00100000:0.0:1788748276.969435:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388543488 00000100:00100000:0.0:1788748276.969474:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788748276.969482:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:8418:x1875638388543488:12345-0@lo:101: 00010000:00010000:0.0:1788748276.969495:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748276.969505:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19d0a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748276.969531:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748276.969542:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748276.969551:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148bc00, rc 0) 00000100:00100000:0.0:1788748276.969595:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388543488:12345-0@lo:101: Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748276.969603:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788748276.969660:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543488:0@lo:101: 00010000:00010000:0.0:1788748276.969672:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748276.969682:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748276.969759:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543616:0@lo:501: 00000100:00100000:0.0:1788748276.969982:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748276.970040:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba607a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748276.972594:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388543616 00000100:00100000:2.0:1788748276.972606:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388543616 00000100:00100000:2.0:1788748276.972657:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788748276.972667:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388543616:12345-0@lo:501: 00000100:00100000:2.0:1788748276.972972:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388543616:12345-0@lo:501: Request processed in 306us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748276.972980:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788748276.973068:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543616:0@lo:501: 00000100:00100000:1.0:1788748276.973116:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543744:0@lo:503: 00000100:00100000:1.0:1788748276.973175:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.973211:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748276.973338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388543744 00000100:00100000:2.0:1788748276.973344:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388543744 00000100:00100000:2.0:1788748276.973369:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788748276.973376:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388543744:12345-0@lo:503: 00000100:00100000:2.0:1788748276.973464:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388543744:12345-0@lo:503: Request processed in 87us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748276.973470:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788748276.973587:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543744:0@lo:503: 00000040:00080000:3.0:1788748276.973826:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748276.973899:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543872:0@lo:502: 00000100:00100000:3.0:1788748276.973947:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.973970:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748276.974081:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388543872 00000100:00100000:1.0:1788748276.974086:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388543872 00000100:00100000:1.0:1788748276.974116:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788748276.974123:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388543872:12345-0@lo:502: 00000100:00100000:1.0:1788748276.974206:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388543872:12345-0@lo:502: Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.974213:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788748276.974249:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388543872:0@lo:502: 00000040:00080000:1.0:1788748276.974441:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788748276.974462:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788748276.974479:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544000:0@lo:502: 00000100:00100000:1.0:1788748276.974510:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.974524:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748276.974540:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544000 00000100:00100000:1.0:1788748276.974543:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544000 00000100:00100000:1.0:1788748276.974558:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788748276.974563:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388544000:12345-0@lo:502: 00000100:00100000:1.0:1788748276.974614:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388544000:12345-0@lo:502: Request processed in 50us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.974621:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788748276.974652:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544000:0@lo:502: 00000040:00080000:1.0:1788748276.974681:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788748276.974688:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788748276.975271:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748276.975281:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748276.975283:0:8445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788748276.975289:0:8445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8addb53d9000 00000020:00000080:3.0:1788748276.975292:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748276.975302:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748276.975305:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748276.975306:0:8445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788748276.975309:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788748276.975474:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788748276.975496:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748276.975516:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.975528:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748276.975572:0:8418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788748276.975575:0:8418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8addb53d9000 10000000:01000000:1.0:1788748276.975578:0:8418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8addb53d9000 10000000:01000000:1.0:1788748276.975582:0:8418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748276.975587:0:8418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8addb53d9000 from 1 10000000:01000000:1.0:1788748276.975591:0:8418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788748276.975613:0:8418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.975622:0:8418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.975640:0:8418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.975654:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544128:0@lo:101: 00000100:00100000:1.0:1788748276.975689:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.975723:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748276.975853:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544128 00000100:00100000:3.0:1788748276.975859:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544128 00000100:00100000:3.0:1788748276.975890:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748276.975898:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8418:x1875638388544128:12345-0@lo:101: 00010000:00010000:3.0:1788748276.975908:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748276.975928:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19d18 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.975951:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.975960:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748276.975968:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76800, rc 0) 00000100:00100000:3.0:1788748276.976007:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544128:12345-0@lo:101: Request processed in 110us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.976013:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788748276.976115:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544128:0@lo:101: 00010000:00010000:1.0:1788748276.976128:0:8418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.976298:0:8418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748276.976404:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544256:0@lo:501: 00000100:00100000:1.0:1788748276.976431:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.976449:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748276.977216:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544256 00000100:00100000:3.0:1788748276.977224:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544256 00000100:00100000:3.0:1788748276.977269:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788748276.977277:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544256:12345-0@lo:501: 00000100:00100000:3.0:1788748276.977416:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544256:12345-0@lo:501: Request processed in 140us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.977424:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788748276.977509:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544256:0@lo:501: 00000100:00100000:1.0:1788748276.977540:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544384:0@lo:503: 00000100:00100000:1.0:1788748276.977582:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.977615:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748276.978220:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544384 00000100:00100000:3.0:1788748276.978226:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544384 00000100:00100000:3.0:1788748276.978260:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788748276.978268:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544384:12345-0@lo:503: 00000100:00100000:3.0:1788748276.978393:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544384:12345-0@lo:503: Request processed in 126us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.978400:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788748276.979003:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544384:0@lo:503: 00000040:00080000:1.0:1788748276.979313:0:8418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748276.980096:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544512:0@lo:502: 00000100:00100000:1.0:1788748276.980370:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.980412:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748276.980470:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544512 00000100:00100000:3.0:1788748276.980476:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544512 00000100:00100000:3.0:1788748276.980512:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788748276.980519:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544512:12345-0@lo:502: 00000100:00100000:3.0:1788748276.980617:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544512:12345-0@lo:502: Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.980625:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788748276.980733:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544512:0@lo:502: 00000040:00080000:1.0:1788748276.981423:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788748276.981454:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788748276.981466:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788748276.981478:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788748276.981489:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788748276.981500:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788748276.981510:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788748276.981522:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788748276.981532:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788748276.981543:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788748276.981554:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788748276.981565:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788748276.981576:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788748276.981587:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788748276.981597:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788748276.981608:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788748276.981632:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788748276.981645:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788748276.981655:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788748276.981666:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788748276.981676:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788748276.981688:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788748276.981698:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788748276.981711:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788748276.981721:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788748276.981733:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788748276.981743:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788748276.981753:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788748276.982874:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788748276.982930:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788748276.982947:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788748276.982971:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788748276.982994:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788748276.983006:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788748276.983018:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788748276.983029:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788748276.983039:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788748276.983085:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544640:0@lo:502: 00000100:00100000:1.0:1788748276.983167:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.983213:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748276.983439:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544640 00000100:00100000:3.0:1788748276.983446:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544640 00000100:00100000:3.0:1788748276.983493:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788748276.983502:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544640:12345-0@lo:502: 00000100:00100000:3.0:1788748276.983610:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388544640:12345-0@lo:502: Request processed in 109us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.983618:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788748276.984046:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388544640:0@lo:502: 00000040:00080000:2.0:1788748276.984142:0:8418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788748276.984154:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788748276.984831:0:8446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788748276.984846:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8addb3d63380) 00000020:00000080:1.0:1788748276.984868:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788748276.984963:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8addb53d9000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788748276.984967:0:8446:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8addb53d9000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788748276.984970:0:8446:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8addb53d9000 3 00010000:00080000:1.0:1788748276.985003:0:8446:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc82c20800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748276.987500:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788748276.987803:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788748276.987857:0:8446:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788748276.987869:0:8446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9ba0f20a02e19d2d 00000100:00080000:1.0:1788748276.987879:0:8446:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748276.987890:0:8446:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc82c20800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748276.987934:0:8446:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc825c1880 x1875638388544768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748276.988004:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388544768:0@lo:38: 00000100:00100000:2.0:1788748276.988074:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748276.988168:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544768 00000100:00100000:3.0:1788748276.988175:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544768 00000100:00100000:3.0:1788748276.988215:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748276.988224:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388544768:12345-0@lo:38: 00010000:00080000:3.0:1788748276.988251:0:6511:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1788748276.988282:0:6511:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9ba0f20a02e19d34 00000004:00100000:3.0:1788748276.988298:0:6511:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788748276.988355:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8adc825be800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788748276.988450:0:8446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788748276.988533:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388545280:0@lo:400: 00000100:00100000:1.0:1788748276.988535:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388544896:0@lo:400: 00000100:00100000:1.0:1788748276.988566:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.988599:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388545024:0@lo:400: 00000100:00100000:1.0:1788748276.988636:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.988655:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748276.988660:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388545152:0@lo:400: 00000100:00100000:1.0:1788748276.988679:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.988702:0:6512:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748276.988709:0:6512:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788748276.988724:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545024 00000100:00100000:1.0:1788748276.988728:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545024 00000100:00100000:1.0:1788748276.988754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748276.988761:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388545024:12345-0@lo:400: 00000100:00100000:1.0:1788748276.988798:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388545024:12345-0@lo:400: Request processed in 37us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.988805:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748276.988823:0:6510:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748276.988829:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388544896 00000100:00100000:1.0:1788748276.988832:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388544896 00000100:00100000:1.0:1788748276.988848:0:6510:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748276.988851:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545152 00000100:00100000:1.0:1788748276.988853:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545152 00000100:00100000:1.0:1788748276.988863:0:6510:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748276.988868:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748276.988873:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388544896:12345-0@lo:400: 00000100:00100000:1.0:1788748276.988906:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388544896:12345-0@lo:400: Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.988912:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748276.989122:0:6510:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748276.989139:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748276.989146:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388545152:12345-0@lo:400: 00000100:00100000:0.0:1788748276.989193:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.989201:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388545152:12345-0@lo:400: Request processed in 53us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.989215:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748276.989235:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545280 00000100:00100000:0.0:1788748276.989241:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545280 00010000:00080000:1.0:1788748276.989266:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc825c3b80 x1875638388544896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748276.989271:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788748276.989283:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388545280:12345-0@lo:400: 00000100:00100000:1.0:1788748276.989286:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388544896:0@lo:400: 00010000:00080000:1.0:1788748276.989349:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc825c1c00 x1875638388545152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748276.989352:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388545280:12345-0@lo:400: Request processed in 70us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748276.989370:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748276.989371:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388545152:0@lo:400: 00000100:00100000:1.0:1788748276.989385:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388545024:0@lo:400: 00000100:00100000:0.0:1788748276.989442:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388545280:0@lo:400: 00000100:00100000:3.0:1788748276.989582:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875638388544768:12345-0@lo:38: Request processed in 1357us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748276.989596:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788748276.989746:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc825c1880 x1875638388544768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748276.989755:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748276.989763:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788748276.989770:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788748276.989780:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788748276.989783:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748276.989789:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388544768:0@lo:38: 00000020:01000004:3.0:1788748276.990463:0:8446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788748276.990479:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8adc825d19c0) 00000020:00000080:3.0:1788748276.990498:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788748276.990600:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8addb53d9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788748276.990604:0:8446:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8addb53d9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788748276.990607:0:8446:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8addb53d9000 3 00010000:00080000:3.0:1788748276.990634:0:8446:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc825b8800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788748276.992756:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1788748276.993005:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788748276.993055:0:8446:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788748276.993067:0:8446:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9ba0f20a02e19d42 00000100:00080000:3.0:1788748276.993077:0:8446:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748276.993089:0:8446:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8adc825b8800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748276.993124:0:8446:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adda73a0000 x1875638388545408/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748276.993170:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875638388545408:0@lo:38: 00000100:00100000:3.0:1788748276.993235:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748276.993434:0:8446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788748276.994190:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545408 00000100:00100000:1.0:1788748276.994200:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545408 00000100:00100000:1.0:1788748276.994238:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748276.994246:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875638388545408:12345-0@lo:38: 00010000:00080000:1.0:1788748276.994274:0:6510:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1788748276.994307:0:6510:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9ba0f20a02e19d49 00000004:00100000:1.0:1788748276.994337:0:6510:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788748276.994371:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8adc82c21800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748276.994443:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875638388545408:12345-0@lo:38: Request processed in 196us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748276.994450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788748276.994506:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adda73a0000 x1875638388545408/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748276.994517:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748276.994525:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788748276.994531:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788748276.994534:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788748276.994537:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc825b8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748276.994542:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875638388545408:0@lo:38: 00000040:00080000:1.0:1788748276.994759:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788748276.997043:0:8418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788748276.997085:0:8418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748276.997110:0:8418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748276.997145:0:8418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788748276.997196:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788748276.997199:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748276.997200:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748276.997201:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748276.997202:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748276.997203:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748276.997205:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748276.997206:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748276.997208:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748276.997210:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748276.997211:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748276.997215:0:8418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788748276.997217:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748276.997218:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788748276.997219:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748276.997220:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748276.997221:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748276.997223:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748276.997224:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748276.997225:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748276.997226:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748276.997227:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748276.997228:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748276.997253:0:8418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788748276.997272:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388545536:0@lo:253: 00000100:00100000:1.0:1788748276.997354:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748276.999284:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748276.999363:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545536 00000100:00100000:2.0:1788748276.999372:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545536 00000100:00100000:2.0:1788748276.999429:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788748276.999441:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388545536:12345-0@lo:253: 20000000:01000000:2.0:1788748276.999474:0:6502:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788748276.999488:0:6502:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788748277.010971:0:6502:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788748277.010995:0:6502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788748277.011510:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788748277.011515:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788748277.011538:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748277.011571:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19c46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748277.011579:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748277.011585:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748277.011623:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748277.011637:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 16 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748277.011651:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388545664:0@lo:104: 00000100:00100000:1.0:1788748277.011713:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748277.011776:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748277.011784:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 16 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748277.011793:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388545792:0@lo:104: 00000100:00100000:1.0:1788748277.011812:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87c8a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788748277.011995:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:8418:x1875638388545536:12345-0@lo:253: Request processed in 12555us (14639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748277.012006:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788748277.012149:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:8418:1875638388545536:0@lo:253: 10000000:01000000:3.0:1788748277.012161:0:8418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788748277.012164:0:8418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748277.012166:0:8418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788748277.012167:0:8418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748277.012168:0:8418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748277.012169:0:8418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748277.012171:0:8418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748277.012172:0:8418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748277.012174:0:8418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788748277.012182:0:8418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788748277.012183:0:8418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748277.012185:0:8418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788748277.012199:0:8418:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788748277.014865:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788748277.014907:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748277.014956:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545664 00000100:00100000:0.0:1788748277.014966:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545664 00000100:00100000:0.0:1788748277.015010:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545792 00000100:00100000:0.0:1788748277.015013:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545792 00000100:00100000:0.0:1788748277.015027:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748277.015035:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6526:x1875638388545664:12345-0@lo:104: 00010000:00010000:0.0:1788748277.015051:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015121:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748277.015127:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6526:x1875638388545664:12345-0@lo:104: Request processed in 93us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748277.015144:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748277.015183:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748277.015190:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388545792:12345-0@lo:104: 00010000:00010000:0.0:1788748277.015197:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015239:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788748277.015245:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388545792:12345-0@lo:104: Request processed in 55us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748277.015250:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788748277.015268:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748277.015275:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015282:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add80030a00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:0.0:1788748277.015286:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015296:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748277.015310:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748277.015336:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748277.015371:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015377:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748277.015399:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015406:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add80030a00/0x9ba0f20a02e19c5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c62 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015417:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788748277.015418:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388545920:0@lo:103: 00010000:00010000:0.0:1788748277.015421:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015425:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add80031e00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:0.0:1788748277.015428:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015434:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748277.015439:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748277.015444:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788748277.015453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748277.015468:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015474:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748277.015486:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015492:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add80031e00/0x9ba0f20a02e19c3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19c46 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.015505:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748277.015507:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748277.015509:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748277.015521:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388546048:0@lo:103: 00000100:00100000:0.0:1788748277.015551:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748277.015613:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388545664:0@lo:104: 00000100:00100000:0.0:1788748277.015622:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388545792:0@lo:104: 00010000:00010000:0.0:1788748277.015642:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748277.015754:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388545920 00000100:00100000:2.0:1788748277.015759:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388545920 00010000:00010000:2.0:1788748277.015785:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 16 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748277.015812:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546048 00000100:00100000:2.0:1788748277.015816:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546048 00010000:00010000:2.0:1788748277.015827:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 17 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748277.015839:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748277.015846:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3636:x1875638388545920:12345-0@lo:103: 00010000:00010000:2.0:1788748277.015856:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748277.015861:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 17 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.015872:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 17 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.015885:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19c62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19c5b expref: 17 pid: 6502 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.015896:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748277.015944:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:3636:x1875638388545920:12345-0@lo:103: Request processed in 98us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748277.015950:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748277.015964:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788748277.015970:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3637:x1875638388546048:12345-0@lo:103: 00010000:00010000:2.0:1788748277.015977:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748277.015981:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19c46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 15 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.015998:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 15 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016008:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19c46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19c3f expref: 15 pid: 6503 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016020:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016027:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748277.016041:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004525569s 00010000:00010000:2.0:1788748277.016045:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016052:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016059:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016065:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016071:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813faa00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748277.016075:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016082:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016101:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748277.016110:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748277.016199:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:3637:x1875638388546048:12345-0@lo:103: Request processed in 229us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748277.016205:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788748277.016231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388545920:0@lo:103: 00010000:00010000:1.0:1788748277.016293:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748277.016416:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388546048:0@lo:103: 00010000:00010000:0.0:1788748277.016434:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.016442:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748277.016449:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19d50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788748277.018150:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788748277.018357:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788748277.018546:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788748277.018714:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788748277.018957:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788748277.019170:0:8418:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788748277.021240:0:8418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788748277.032123:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788748277.032253:0:8418:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788748277.032259:0:8418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788748277.032294:0:8418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788748277.032350:0:8418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788748277.032374:0:8418:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788748277.032392:0:8418:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788748277.033384:0:8418:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788748277.033558:0:8418:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:3.0:1788748277.812181:0:8504:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788748277.812415:0:8504:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788748278.059982:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748278.565492:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748278.565515:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388546176:0@lo:41: 00000100:00100000:1.0:1788748278.565592:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748278.565665:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546176 00000100:00100000:1.0:1788748278.565673:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546176 00000100:00100000:1.0:1788748278.565719:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748278.565727:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388546176:12345-0@lo:41: 00000004:00000024:1.0:1788748278.565764:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788748278.565808:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388546176:12345-0@lo:41: Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748278.565814:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748278.565860:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388546176:0@lo:41: 00010000:00010000:1.0:1788748279.080277:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748280.104270:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748280.617846:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388546304:0@lo:41: 00000100:00100000:0.0:1788748280.617930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748280.618398:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546304 00000100:00100000:1.0:1788748280.618408:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546304 00000100:00100000:1.0:1788748280.618465:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748280.618475:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388546304:12345-0@lo:41: 00000004:00000024:1.0:1788748280.618510:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788748280.618565:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388546304:12345-0@lo:41: Request processed in 91us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748280.618571:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788748280.618688:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388546304:0@lo:41: 00010000:00010000:0.0:1788748281.124458:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748281.636577:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788748281.636583:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8add8f106000 from 30 10000000:01000000:0.0:1788748281.636587:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748281.636630:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.636642:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.636652:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748281.636674:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388546432:0@lo:101: 00000100:00100000:0.0:1788748281.637149:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.637202:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add853720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.637266:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546432 00000100:00100000:3.0:1788748281.637275:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546432 00000100:00100000:3.0:1788748281.637489:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788748281.637500:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:6507:x1875638388546432:12345-0@lo:101: 00010000:00010000:3.0:1788748281.637515:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748281.637528:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19d57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.637552:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.637579:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.637589:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77800, rc 0) 00000100:00100000:3.0:1788748281.637638:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388546432:12345-0@lo:101: Request processed in 140us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.638501:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788748281.639162:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388546432:0@lo:101: 00010000:00010000:2.0:1788748281.639185:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.639196:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748281.639271:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388546560:0@lo:501: 00000100:00100000:2.0:1788748281.639335:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.639373:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.639443:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546560 00000100:00100000:0.0:1788748281.639451:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546560 00000100:00100000:0.0:1788748281.639491:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788748281.639501:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388546560:12345-0@lo:501: 00000100:00100000:0.0:1788748281.639623:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388546560:12345-0@lo:501: Request processed in 123us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.639630:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788748281.639679:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388546560:0@lo:501: 00000100:00100000:0.0:1788748281.639705:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388546688:0@lo:503: 00000100:00100000:0.0:1788748281.639741:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.639761:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.639771:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546688 00000100:00100000:0.0:1788748281.639774:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546688 00000100:00100000:0.0:1788748281.639790:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748281.639796:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388546688:12345-0@lo:503: 00000100:00100000:0.0:1788748281.639866:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388546688:12345-0@lo:503: Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.639872:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748281.639920:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388546688:0@lo:503: 00000100:00100000:0.0:1788748281.640087:0:8730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8730:1875638388546816:0@lo:502: 00000100:00100000:0.0:1788748281.640118:0:8730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.640135:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546816 00000100:00100000:0.0:1788748281.640139:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546816 00000100:00100000:0.0:1788748281.640155:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748281.640160:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8730:x1875638388546816:12345-0@lo:502: 00000100:00100000:0.0:1788748281.640224:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8730:x1875638388546816:12345-0@lo:502: Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.640230:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748281.640255:0:8730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.640266:0:8730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8730:1875638388546816:0@lo:502: 00000100:00100000:0.0:1788748281.640301:0:8730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8730:1875638388546944:0@lo:502: 00000100:00100000:0.0:1788748281.640378:0:8730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.640401:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388546944 00000100:00100000:0.0:1788748281.640405:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388546944 00000100:00100000:0.0:1788748281.640421:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788748281.640426:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8730:x1875638388546944:12345-0@lo:502: 00000100:00100000:0.0:1788748281.640480:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:8730:x1875638388546944:12345-0@lo:502: Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.640486:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788748281.640516:0:8730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.640527:0:8730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8730:1875638388546944:0@lo:502: 00000040:00080000:0.0:1788748281.640545:0:8730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788748281.640595:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788748281.640612:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748281.640620:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.640630:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748281.640638:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748281.640640:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add8f106000 from 5 10000000:01000000:0.0:1788748281.640643:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748281.640665:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.640672:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.640680:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748281.640701:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547072:0@lo:101: 00000100:00100000:0.0:1788748281.640724:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.640736:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.640747:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547072 00000100:00100000:0.0:1788748281.640750:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547072 00000100:00100000:0.0:1788748281.640766:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788748281.640771:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388547072:12345-0@lo:101: 00010000:00010000:0.0:1788748281.640779:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748281.640790:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19d65 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.640808:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.640817:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.640824:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:0.0:1788748281.640849:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388547072:12345-0@lo:101: Request processed in 78us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.640855:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788748281.640882:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547072:0@lo:101: 00010000:00010000:0.0:1788748281.640901:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.640909:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748281.642636:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547200:0@lo:256: 00000100:00100000:0.0:1788748281.642693:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.642726:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.642743:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547200 00000100:00100000:0.0:1788748281.642749:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547200 00000100:00100000:0.0:1788748281.642786:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788748281.642798:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388547200:12345-0@lo:256: 20000000:01000000:0.0:1788748281.642816:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788748281.642833:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788748281.642836:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788748281.642926:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388547200:12345-0@lo:256: Request processed in 132us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.642933:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788748281.642970:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547200:0@lo:256: 10000000:01000000:0.0:1788748281.643013:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748281.643035:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.643047:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748281.643055:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788748281.643058:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788748281.643061:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788748281.643080:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.643098:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.643107:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748281.643119:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547328:0@lo:101: 00000100:00100000:0.0:1788748281.643144:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.643158:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.643170:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547328 00000100:00100000:0.0:1788748281.643174:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547328 00000100:00100000:0.0:1788748281.643488:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788748281.643496:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388547328:12345-0@lo:101: 00010000:00010000:0.0:1788748281.643506:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748281.643529:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19d73 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.643552:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.645737:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.645753:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748281.645831:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388547328:12345-0@lo:101: Request processed in 2335us (2685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.645839:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788748281.645988:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547328:0@lo:101: 00010000:00010000:2.0:1788748281.646010:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.646021:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748281.646349:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547456:0@lo:501: 00000100:00100000:2.0:1788748281.646809:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.646854:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.646864:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547456 00000100:00100000:0.0:1788748281.646879:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547456 00000100:00100000:0.0:1788748281.646927:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788748281.646935:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388547456:12345-0@lo:501: 00000100:00100000:0.0:1788748281.647279:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388547456:12345-0@lo:501: Request processed in 344us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.647287:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788748281.647366:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547456:0@lo:501: 00000100:00100000:2.0:1788748281.647399:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547584:0@lo:503: 00000100:00100000:2.0:1788748281.647440:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.647469:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.647650:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547584 00000100:00100000:0.0:1788748281.647655:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547584 00000100:00100000:0.0:1788748281.647685:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788748281.647692:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388547584:12345-0@lo:503: 00000100:00100000:0.0:1788748281.647778:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388547584:12345-0@lo:503: Request processed in 86us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.647785:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788748281.647843:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388547584:0@lo:503: 00000100:00100000:2.0:1788748281.648532:0:8731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8731:1875638388547712:0@lo:502: 00000100:00100000:2.0:1788748281.648575:0:8731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.648828:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547712 00000100:00100000:0.0:1788748281.648834:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547712 00000100:00100000:0.0:1788748281.648868:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788748281.648970:0:8731:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.649009:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8731:x1875638388547712:12345-0@lo:502: 00000100:00100000:0.0:1788748281.649131:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8731:x1875638388547712:12345-0@lo:502: Request processed in 125us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.649139:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788748281.649228:0:8731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8731:1875638388547712:0@lo:502: 00000020:01000000:2.0:1788748281.649263:0:8731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788748281.649270:0:8731:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788748281.649277:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748281.649279:0:8731:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788748281.649285:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788748281.649289:0:8731:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:2.0:1788748281.649310:0:8731:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788748281.649313:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788748281.649354:0:8731:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8addb538cd40) 00000020:00000080:2.0:1788748281.649375:0:8731:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788748281.649382:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788748281.649461:0:8731:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788748281.649468:0:8731:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788748281.649474:0:8731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e19d88 00010000:00080000:2.0:1788748281.649500:0:8731:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8addbf46d000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788748281.649777:0:8731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788748281.662157:0:8731:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788748281.662387:0:8731:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788748281.662580:0:8731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748281.663391:0:8731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748281.663479:0:8731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788748281.663555:0:8731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788748281.664565:0:8732:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748281.664570:0:8732:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788748281.666635:0:8731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788748281.666650:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788748281.666691:0:8731:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788748281.666719:0:8731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e19d8f 00000100:00080000:0.0:1788748281.666729:0:8731:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748281.666740:0:8731:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8addbf46d000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748281.666774:0:8731:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8addb3929880 x1875638388547840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748281.666846:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388547840:0@lo:8: 00000100:00100000:2.0:1788748281.666924:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.667010:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547840 00000100:00100000:0.0:1788748281.667018:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547840 00000100:00100000:0.0:1788748281.667057:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748281.667066:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875638388547840:12345-0@lo:8: 00000100:00100000:1.0:1788748281.667067:0:8425:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788748281.667078:0:8425:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1788748281.667095:0:8424:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1788748281.667126:0:8424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e19d96 00002000:00100000:0.0:1788748281.667154:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8adc82562000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788748281.667159:0:8424:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788748281.667163:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788748281.667237:0:8424:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788748281.667528:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788748281.667550:0:8424:0:(import.c:65:import_set_state_nolock()) ffff8adc82567000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748281.667827:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875638388547840:12345-0@lo:8: Request processed in 761us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.667834:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788748281.667852:0:8731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788748281.667955:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388547968:0@lo:400: 00000100:00100000:0.0:1788748281.667994:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.668018:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388548480:0@lo:400: 00000100:00100000:0.0:1788748281.668039:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.668055:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748281.668059:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388548352:0@lo:400: 00000100:00100000:0.0:1788748281.668078:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.668107:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388548096:0@lo:400: 00000100:00100000:0.0:1788748281.668126:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.668148:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388548608:0@lo:400: 00000100:00100000:0.0:1788748281.668180:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.668197:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748281.668201:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388548224:0@lo:400: 00000100:00100000:0.0:1788748281.668232:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.668257:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388547968 00000100:00100000:0.0:1788748281.668262:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388547968 00000100:00100000:0.0:1788748281.668295:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548480 00000100:00100000:0.0:1788748281.668298:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548480 00000100:00100000:0.0:1788748281.668335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548608 00000100:00100000:0.0:1788748281.668339:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548608 00000100:00100000:0.0:1788748281.668354:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548224 00000100:00100000:0.0:1788748281.668357:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548224 00000100:00100000:3.0:1788748281.668373:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748281.668387:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388547968:12345-0@lo:400: 00000100:00100000:0.0:1788748281.668390:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748281.668402:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388548480:12345-0@lo:400: 00000100:00100000:3.0:1788748281.668451:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388547968:12345-0@lo:400: Request processed in 68us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.668457:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388548480:12345-0@lo:400: Request processed in 56us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.668462:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748281.668470:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748281.668484:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748281.668491:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788748281.668496:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388548608:12345-0@lo:400: 00000100:00100000:0.0:1788748281.668502:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388548224:12345-0@lo:400: 00000100:00100000:3.0:1788748281.668537:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388548608:12345-0@lo:400: Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.668545:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388548224:12345-0@lo:400: Request processed in 43us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.668548:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748281.668558:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748281.668584:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548352 00000100:00100000:0.0:1788748281.668587:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548352 00000100:00100000:0.0:1788748281.668615:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548096 00000100:00100000:0.0:1788748281.668618:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548096 00000100:00100000:0.0:1788748281.668632:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748281.668638:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388548352:12345-0@lo:400: 00000100:00100000:0.0:1788748281.668679:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388548352:12345-0@lo:400: Request processed in 41us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.668685:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748281.668699:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748281.668706:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388548096:12345-0@lo:400: 00000100:00100000:0.0:1788748281.668731:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388548096:12345-0@lo:400: Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.668736:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788748281.668763:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748281.668767:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788748281.668790:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb3929c00 x1875638388548224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.668802:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388548224:0@lo:400: 00000100:00100000:0.0:1788748281.668813:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388548096:0@lo:400: 00010000:00080000:0.0:1788748281.668822:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8add8f162680 x1875638388548608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.668829:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388548608:0@lo:400: 00000100:00100000:0.0:1788748281.668858:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388548352:0@lo:400: 00010000:00080000:0.0:1788748281.668867:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb3929180 x1875638388547968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.668875:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388547968:0@lo:400: 00010000:00080000:0.0:1788748281.668883:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb392b800 x1875638388548480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.668904:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388548480:0@lo:400: 00000020:01000000:0.0:1788748281.668996:0:8731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748281.669003:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748281.669005:0:8731:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788748281.669008:0:8731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748281.669012:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748281.669014:0:8731:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748281.669017:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748281.669018:0:8731:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788748281.669042:0:8731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8731:1875638388548736:0@lo:502: 00000100:00100000:0.0:1788748281.669088:0:8731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.669111:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548736 00000100:00100000:0.0:1788748281.669115:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548736 00000100:00100000:0.0:1788748281.669141:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788748281.669148:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8731:x1875638388548736:12345-0@lo:502: 00000100:00100000:0.0:1788748281.669241:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:8731:x1875638388548736:12345-0@lo:502: Request processed in 93us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.669248:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788748281.669292:0:8731:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a69180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.669305:0:8731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8731:1875638388548736:0@lo:502: 00000020:01000000:0.0:1788748281.669342:0:8731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748281.669346:0:8731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748281.669347:0:8731:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788748281.669351:0:8731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1788748281.669491:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788748281.669513:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788748281.669522:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.669533:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748281.669544:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788748281.669552:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adda7357000 from 30 10000000:01000000:3.0:1788748281.669555:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748281.669578:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.669586:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.669595:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748281.669608:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388548864:0@lo:101: 00000100:00100000:3.0:1788748281.669643:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.669671:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.669704:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548864 00000100:00100000:0.0:1788748281.669709:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548864 00000100:00100000:0.0:1788748281.669734:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788748281.669741:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388548864:12345-0@lo:101: 00010000:00010000:0.0:1788748281.669749:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748281.669761:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19d9d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.669791:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.669802:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.669810:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940e00, rc 0) 00000100:00100000:0.0:1788748281.669850:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388548864:12345-0@lo:101: Request processed in 109us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.669856:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1788748281.670126:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb3929880 x1875638388547840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748281.670136:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748281.670142:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788748281.670150:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788748281.670155:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788748281.670158:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addbf46d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788748281.670203:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788748281.670218:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388547840:0@lo:8: 00000004:00080000:2.0:1788748281.670242:0:8732:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788748281.670306:0:8732:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 198656989220ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788748281.670313:0:8732:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788748281.671124:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388548864:0@lo:101: 00010000:00010000:3.0:1788748281.671143:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.671156:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748281.671220:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388548992:0@lo:501: 00000100:00100000:3.0:1788748281.671260:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.671270:0:8733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388549120:0@lo:700: 00000100:00100000:3.0:1788748281.671298:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.671409:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388548992 00000100:00100000:0.0:1788748281.671415:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388548992 00000100:00100000:0.0:1788748281.671443:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788748281.671449:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388548992:12345-0@lo:501: 00000100:00100000:0.0:1788748281.671552:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388548992:12345-0@lo:501: Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.671559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788748281.671600:0:8733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.671618:0:8733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748281.671679:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388549120 00000100:00100000:2.0:1788748281.671684:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388549120 00000100:00100000:2.0:1788748281.671722:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748281.671729:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8733:x1875638388549120:12345-0@lo:700: 00000100:00100000:1.0:1788748281.671735:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:1.0:1788748281.671744:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:2.0:1788748281.671759:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1875638388549248:0@lo:700: 00000100:00100000:2.0:1788748281.671783:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.671804:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748281.671910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388549248 00000100:00100000:1.0:1788748281.671915:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388549248 00000100:00100000:1.0:1788748281.672057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748281.672066:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1875638388549248:12345-0@lo:700: 00000100:00080000:0.0:1788748281.672431:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748281.672976:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388548992:0@lo:501: 00000100:00100000:3.0:1788748281.673017:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388549376:0@lo:503: 00000100:00100000:3.0:1788748281.673073:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.673103:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.673143:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388549376 00000100:00100000:0.0:1788748281.673149:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388549376 00000100:00100000:0.0:1788748281.673177:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788748281.673184:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388549376:12345-0@lo:503: 00000100:00100000:0.0:1788748281.673273:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388549376:12345-0@lo:503: Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.673429:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788748281.673460:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388549376:0@lo:503: 00000100:00100000:3.0:1788748281.673959:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8736:1875638388549504:0@lo:502: 00000100:00100000:3.0:1788748281.673998:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.674032:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.674076:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388549504 00000100:00100000:0.0:1788748281.674080:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388549504 00000100:00100000:0.0:1788748281.674105:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788748281.674113:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8736:x1875638388549504:12345-0@lo:502: 00000100:00100000:0.0:1788748281.674797:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8736:x1875638388549504:12345-0@lo:502: Request processed in 683us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.674806:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000004:00080000:0.0:1788748281.675429:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788748281.675608:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8736:1875638388549504:0@lo:502: 00000100:00100000:3.0:1788748281.675663:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8736:1875638388549632:0@lo:502: 00000100:00100000:3.0:1788748281.675706:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.675742:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748281.675792:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388549632 00000100:00100000:2.0:1788748281.675798:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388549632 00000100:00100000:2.0:1788748281.675842:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788748281.675848:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8736:x1875638388549632:12345-0@lo:502: 00000100:00100000:2.0:1788748281.675959:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:8736:x1875638388549632:12345-0@lo:502: Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.675967:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788748281.676049:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8736:1875638388549632:0@lo:502: 00000040:00080000:3.0:1788748281.676066:0:8736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788748281.676215:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788748281.676237:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748281.676246:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.676256:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748281.676265:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788748281.676268:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adda7357000 from 5 10000000:01000000:2.0:1788748281.676270:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748281.676303:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.676312:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.676345:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748281.676358:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388549760:0@lo:101: 00000100:00100000:2.0:1788748281.676506:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.676534:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.676594:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388549760 00000100:00100000:3.0:1788748281.676599:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388549760 00000100:00100000:3.0:1788748281.676631:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788748281.676638:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388549760:12345-0@lo:101: 00010000:00010000:3.0:1788748281.676647:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748281.676658:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19dab expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.676678:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.676688:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.676697:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76600, rc 0) 00000100:00100000:3.0:1788748281.676730:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388549760:12345-0@lo:101: Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.676745:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788748281.676822:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388549760:0@lo:101: 00010000:00010000:2.0:1788748281.676832:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.676840:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748281.676880:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388549888:0@lo:256: 00000100:00100000:2.0:1788748281.676918:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.676946:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.676990:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388549888 00000100:00100000:3.0:1788748281.676995:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388549888 00000100:00100000:3.0:1788748281.677023:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788748281.677030:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388549888:12345-0@lo:256: 20000000:01000000:3.0:1788748281.677042:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748281.677060:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748281.677063:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788748281.677147:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388549888:12345-0@lo:256: Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.677154:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788748281.677218:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388549888:0@lo:256: 10000000:01000000:2.0:1788748281.677253:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788748281.677258:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.677265:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748281.677272:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788748281.677273:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788748281.677276:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788748281.677833:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.677842:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.677849:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748281.677870:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550016:0@lo:101: 00000100:00100000:2.0:1788748281.677910:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.677929:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add88428f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748281.677943:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550016 00000100:00100000:2.0:1788748281.677947:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550016 00000100:00100000:2.0:1788748281.677972:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788748281.677978:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388550016:12345-0@lo:101: 00010000:00010000:2.0:1788748281.677986:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748281.677997:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.678013:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.678021:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.678027:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6a00, rc 0) 00000100:00100000:2.0:1788748281.678052:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388550016:12345-0@lo:101: Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.678058:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788748281.678087:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550016:0@lo:101: 00010000:00010000:2.0:1788748281.678096:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748281.678104:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748281.678157:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550144:0@lo:501: 00000100:00100000:2.0:1788748281.678179:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.678190:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add88428f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748281.678200:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550144 00000100:00100000:2.0:1788748281.678203:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550144 00000100:00100000:2.0:1788748281.678219:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788748281.678224:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388550144:12345-0@lo:501: 00000100:00100000:2.0:1788748281.678451:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388550144:12345-0@lo:501: Request processed in 226us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.678458:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788748281.678482:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550144:0@lo:501: 00000100:00100000:2.0:1788748281.678513:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550272:0@lo:503: 00000100:00100000:2.0:1788748281.678546:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.678558:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add88428f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748281.678572:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550272 00000100:00100000:2.0:1788748281.678575:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550272 00000100:00100000:2.0:1788748281.678593:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788748281.678598:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388550272:12345-0@lo:503: 00000100:00100000:2.0:1788748281.678657:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388550272:12345-0@lo:503: Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.678663:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788748281.678693:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550272:0@lo:503: 00000100:00100000:2.0:1788748281.678840:0:8737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8737:1875638388550400:0@lo:502: 00000100:00100000:2.0:1788748281.678868:0:8737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.678904:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550400 00000100:00100000:2.0:1788748281.678908:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550400 00000100:00100000:2.0:1788748281.678930:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788748281.678938:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:8737:x1875638388550400:12345-0@lo:502: 00000100:00100000:2.0:1788748281.679006:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:8737:x1875638388550400:12345-0@lo:502: Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.679012:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788748281.679039:0:8737:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add884289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748281.679050:0:8737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8737:1875638388550400:0@lo:502: 00000020:01000000:2.0:1788748281.679068:0:8737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788748281.679075:0:8737:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788748281.679082:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748281.679084:0:8737:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788748281.679091:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788748281.679094:0:8737:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:2.0:1788748281.679116:0:8737:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788748281.679119:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 40000000:02000000:1.0:1788748281.679132:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:00000080:2.0:1788748281.679134:0:8737:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8addb53899c0) 00000020:00000080:2.0:1788748281.679158:0:8737:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788748281.679164:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788748281.679233:0:8737:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788748281.679238:0:8737:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788748281.679245:0:8737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19dce 00010000:00080000:2.0:1788748281.679280:0:8737:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc8387f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788748281.679747:0:8737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1788748281.685842:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1875638388549248:12345-0@lo:700: Request processed in 13770us (14049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748281.685857:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788748281.686497:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb533dc00 x1875638388549248/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.686512:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1875638388549248:0@lo:700: 40000000:02000000:3.0:1788748281.686525:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1788748281.697169:0:8737:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788748281.697193:0:8737:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788748281.698674:0:8737:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748281.698990:0:8737:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748281.699129:0:8737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788748281.699231:0:8737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788748281.706458:0:8738:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748281.706467:0:8738:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788748281.708287:0:8737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748281.708302:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788748281.708365:0:8737:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788748281.708391:0:8737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e19dd5 00000100:00080000:0.0:1788748281.708402:0:8737:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748281.708413:0:8737:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8adc8387f800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748281.708449:0:8737:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8addb3929880 x1875638388550528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748281.708475:0:8737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788748281.708528:0:8737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748281.708532:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748281.708535:0:8737:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788748281.708538:0:8737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748281.708542:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748281.708544:0:8737:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748281.708546:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748281.708548:0:8737:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788748281.708582:0:8737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8737:1875638388550656:0@lo:502: 00000100:00100000:0.0:1788748281.708655:0:8737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.710232:0:8737:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.710789:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388550528:0@lo:8: 00000100:00100000:0.0:1788748281.710852:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748281.712139:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550656 00000100:00100000:3.0:1788748281.712153:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550656 00000100:00100000:3.0:1788748281.712208:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788748281.712217:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:8737:x1875638388550656:12345-0@lo:502: 00000100:00100000:3.0:1788748281.712396:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:8737:x1875638388550656:12345-0@lo:502: Request processed in 178us (3738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.712406:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788748281.712470:0:8737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:8737:1875638388550656:0@lo:502: 00000020:01000000:3.0:1788748281.712500:0:8737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748281.712507:0:8737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748281.712509:0:8737:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788748281.712520:0:8737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1788748281.712925:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550528 00000100:00100000:2.0:1788748281.712931:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550528 00000100:00100000:2.0:1788748281.713002:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748281.713008:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875638388550528:12345-0@lo:8: 00010000:00080000:2.0:1788748281.713033:0:8427:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1788748281.713062:0:8427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e19ddc 00002000:00100000:2.0:1788748281.713076:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8adc83878800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788748281.713080:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788748281.713083:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788748281.713153:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788748281.713175:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8adc8387d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748281.713233:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875638388550528:12345-0@lo:8: Request processed in 225us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.713240:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788748281.713307:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb3929880 x1875638388550528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.713344:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748281.713352:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788748281.713359:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788748281.713364:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788748281.713366:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc8387f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788748281.713378:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788748281.713383:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388550528:0@lo:8: 00000004:00080000:0.0:1788748281.713407:0:8738:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788748281.713455:0:8738:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 198700137659ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788748281.713461:0:8738:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:0.0:1788748281.714757:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788748281.714788:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788748281.714798:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.714811:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748281.714821:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788748281.714823:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8add9ea619c0 from 1 10000000:01000000:0.0:1788748281.714826:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788748281.714874:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.714882:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.714902:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748281.714924:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550784:0@lo:101: 00000100:00100000:0.0:1788748281.714973:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.715020:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.715127:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550784 00000100:00100000:3.0:1788748281.715134:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550784 00000100:00100000:3.0:1788748281.715175:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788748281.715184:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388550784:12345-0@lo:101: 00010000:00010000:3.0:1788748281.715195:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748281.715207:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19de3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.715230:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.715241:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.715253:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77a00, rc 0) 00000100:00100000:3.0:1788748281.715299:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388550784:12345-0@lo:101: Request processed in 116us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.715305:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788748281.715314:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550784:0@lo:101: 00010000:00010000:0.0:1788748281.715353:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748281.715362:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748281.715415:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550912:0@lo:501: 00000100:00100000:0.0:1788748281.715441:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.715691:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.715756:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388550912 00000100:00100000:3.0:1788748281.715761:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388550912 00000100:00100000:3.0:1788748281.716903:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788748281.716919:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388550912:12345-0@lo:501: 00000100:00100000:3.0:1788748281.717024:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388550912:12345-0@lo:501: Request processed in 111us (1581us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788748281.717031:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788748281.718073:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388550912:0@lo:501: 10000000:01000000:3.0:1788748281.718117:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788748281.718132:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748281.718143:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788748281.718588:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788748281.718984:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8733:x1875638388549120:12345-0@lo:700: Request processed in 47248us (47375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748281.719000:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1788748281.719062:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788748281.719147:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388551040:0@lo:13: 00000100:00100000:0.0:1788748281.719190:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.719225:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551040 00000100:00100000:2.0:1788748281.719233:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551040 00000004:00080000:0.0:1788748281.719237:0:8741:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788748281.719269:0:8741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388551168:0@lo:7: 00000100:00100000:0.0:1788748281.719298:0:8741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.719314:0:8741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786b40 going to sleep for 11 seconds 00010000:00080000:3.0:1788748281.719476:0:8733:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8add8f162680 x1875638388549120/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.719489:0:8733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388549120:0@lo:700: 00000100:00100000:3.0:1788748281.719577:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551168 00000100:00100000:3.0:1788748281.719581:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551168 00000100:00100000:2.0:1788748281.719670:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748281.719682:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388551040:12345-0@lo:13: 00002000:00000024:2.0:1788748281.719706:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788748281.719746:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388551040:12345-0@lo:13: Request processed in 68us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.719754:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748281.719759:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748281.719770:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8741:x1875638388551168:12345-0@lo:7: 00000100:00080000:2.0:1788748281.719775:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788748281.719800:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb392bb80 x1875638388551040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748281.719817:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388551040:0@lo:13: 00002000:00080000:3.0:1788748281.724990:0:8734:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788748281.724999:0:8734:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788748281.726072:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8741:x1875638388551168:12345-0@lo:7: Request processed in 6299us (6767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.726084:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788748281.726489:0:8741:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb3929c00 x1875638388551168/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.726506:0:8741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388551168:0@lo:7: 00000004:00080000:0.0:1788748281.726520:0:8741:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788748281.726576:0:8741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388551296:0@lo:5: 00000100:00100000:0.0:1788748281.726622:0:8741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.726656:0:8741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.727234:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551296 00000100:00100000:3.0:1788748281.727242:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551296 00000100:00100000:3.0:1788748281.727288:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748281.727297:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8741:x1875638388551296:12345-0@lo:5: 00002000:00080000:3.0:1788748281.727355:0:8425:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788748281.727359:0:8425:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788748281.730290:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388551424:0@lo:13: 00000100:00100000:3.0:1788748281.730375:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.730442:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551424 00000100:00100000:2.0:1788748281.730451:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551424 00000004:00080000:0.0:1788748281.730491:0:8733:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788748281.730503:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748281.730513:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388551424:12345-0@lo:13: 00000100:00100000:0.0:1788748281.730534:0:8733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388551552:0@lo:7: 00002000:00000024:2.0:1788748281.730535:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788748281.730568:0:8733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.730587:0:8733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748281.730612:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551552 00000100:00100000:0.0:1788748281.730615:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551552 00000100:00100000:2.0:1788748281.730653:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875638388551424:12345-0@lo:13: Request processed in 140us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748281.730660:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788748281.731020:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb392bb80 x1875638388551424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.731046:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388551424:0@lo:13: 00000100:00100000:3.0:1788748281.731093:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748281.731102:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8733:x1875638388551552:12345-0@lo:7: 00000001:00080000:0.0:1788748281.732306:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788748281.732336:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788748281.732475:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8741:x1875638388551296:12345-0@lo:5: Request processed in 5177us (5850us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788748281.732484:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788748281.732546:0:8741:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb3929c00 x1875638388551296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.732557:0:8741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788748281.732563:0:8741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388551296:0@lo:5: 00000004:00080000:0.0:1788748281.732578:0:8741:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788748281.732614:0:8741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388551680:0@lo:700: 00000100:00100000:0.0:1788748281.732967:0:8741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.732996:0:8741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748281.732998:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551680 00000100:00100000:2.0:1788748281.733006:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551680 00000100:00100000:2.0:1788748281.733048:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748281.733058:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8741:x1875638388551680:12345-0@lo:700: 00002000:00080000:3.0:1788748281.738580:0:8734:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788748281.738589:0:8734:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00010000:00080000:0.0:1788748281.738830:0:8733:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc82fdc380 x1875638388551552/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.738913:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8733:x1875638388551552:12345-0@lo:7: Request processed in 7811us (8343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.738923:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748281.738973:0:8733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388551552:0@lo:7: 00000004:00080000:0.0:1788748281.738987:0:8733:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788748281.739294:0:8733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388551808:0@lo:5: 00000100:00100000:0.0:1788748281.739398:0:8733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.739422:0:8733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786900 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.739482:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551808 00000100:00100000:3.0:1788748281.739490:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551808 00000100:00100000:3.0:1788748281.739594:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748281.739604:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8733:x1875638388551808:12345-0@lo:5: 00002000:00080000:3.0:1788748281.739637:0:8427:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00010000:00080000:0.0:1788748281.739819:0:8733:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc82fdc380 x1875638388551808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.739830:0:8733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388551808:0@lo:5: 00000100:00100000:3.0:1788748281.739984:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8733:x1875638388551808:12345-0@lo:5: Request processed in 382us (585us total) trans 0 rc 0/0 00000004:00080000:0.0:1788748281.739990:0:8733:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788748281.739992:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748281.740018:0:8733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388551936:0@lo:5: 00000100:00100000:0.0:1788748281.740042:0:8733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.740064:0:8733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786900 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.740077:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388551936 00000100:00100000:3.0:1788748281.740081:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388551936 00000100:00100000:3.0:1788748281.740109:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748281.740117:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8733:x1875638388551936:12345-0@lo:5: 00002000:00080000:3.0:1788748281.740141:0:8425:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788748281.745543:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8733:x1875638388551936:12345-0@lo:5: Request processed in 5420us (5493us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788748281.745555:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788748281.746479:0:8733:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc82fdc380 x1875638388551936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.746513:0:8733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8733:1875638388551936:0@lo:5: 00000004:00080000:3.0:1788748281.746529:0:8733:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788748281.746569:0:8733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8733:1875638388552064:0@lo:900: 00000100:00100000:2.0:1788748281.746753:0:8733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748281.746779:0:8733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba607a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.746831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552064 00000100:00100000:3.0:1788748281.746838:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552064 00000100:00100000:3.0:1788748281.746880:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748281.746897:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8733:x1875638388552064:12345-0@lo:900: 00000100:00100000:3.0:1788748281.746951:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8733:x1875638388552064:12345-0@lo:900: Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.746958:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748281.747041:0:8733:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adda73a0000 x1875638388552064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748281.747052:0:8733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8733:1875638388552064:0@lo:900: 00000001:00080000:0.0:1788748281.748815:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1788748281.748964:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8741:x1875638388551680:12345-0@lo:700: Request processed in 15906us (15995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748281.748980:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788748281.749086:0:8741:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc82fdce00 x1875638388551680/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748281.749101:0:8741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388551680:0@lo:700: 00000004:02000040:0.0:1788748281.750341:0:8741:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788748281.756776:0:8741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388552192:0@lo:5: 00000100:00100000:0.0:1788748281.756846:0:8741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748281.756906:0:8741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748281.757463:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552192 00000100:00100000:3.0:1788748281.757472:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552192 00000100:00100000:2.0:1788748281.757562:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748281.757644:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8741:x1875638388552192:12345-0@lo:5: 00002000:00080000:3.0:1788748281.775006:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788748281.775027:0:8427:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788748281.776572:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8741:x1875638388552192:12345-0@lo:5: Request processed in 18995us (19720us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788748281.776584:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788748281.776638:0:8741:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc82fdce00 x1875638388552192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748297 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748281.776653:0:8741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8741:1875638388552192:0@lo:5: 00000004:00080000:3.0:1788748281.776668:0:8741:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788748282.148652:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748282.625457:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788748283.185043:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788748283.523889:0:8855:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748283.524563:0:8855:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788748283.686073:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748283.686108:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388552320:0@lo:41: 00000100:00100000:3.0:1788748283.686175:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748283.686245:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552320 00000100:00100000:3.0:1788748283.686254:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552320 00000100:00100000:3.0:1788748283.686311:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748283.686340:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388552320:12345-0@lo:41: 00000004:00000024:3.0:1788748283.687151:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788748283.687224:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388552320:12345-0@lo:41: Request processed in 885us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748283.687231:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748283.687511:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388552320:0@lo:41: 00010000:00010000:2.0:1788748284.196918:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788748284.380693:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788748285.221267:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748285.732569:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388552448:0@lo:41: 00000100:00100000:0.0:1788748285.732640:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748285.732771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552448 00000100:00100000:3.0:1788748285.732780:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552448 00000100:00100000:3.0:1788748285.732830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788748285.732839:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388552448:12345-0@lo:41: 00000004:00000024:3.0:1788748285.732973:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788748285.733171:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388552448:12345-0@lo:41: Request processed in 332us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748285.733179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788748285.733248:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388552448:0@lo:41: 00000020:00000004:0.0:1788748286.063591:0:8957:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748286.063897:0:8957:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748286.246973:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748286.756601:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748286.756636:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388552576:0@lo:13: 00000100:00100000:3.0:1788748286.756726:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748286.756826:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552576 00000100:00100000:3.0:1788748286.756835:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552576 00000100:00100000:3.0:1788748286.756913:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748286.756925:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388552576:12345-0@lo:13: 00002000:00000024:3.0:1788748286.756962:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748286.757011:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388552576:12345-0@lo:13: Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748286.757027:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788748286.757052:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788748286.757125:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adda73a2300 x1875638388552576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748286.757137:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788748286.757161:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388552576:0@lo:13: 00000100:00100000:2.0:1788748286.757728:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388552704:0@lo:13: 00000100:00100000:2.0:1788748286.757776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.758042:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388552832:0@lo:400: 00000100:00100000:2.0:1788748286.758081:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.758110:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388553344:0@lo:400: 00000100:00100000:2.0:1788748286.758137:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748286.758158:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388553216:0@lo:400: 00000100:00100000:1.0:1788748286.758198:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748286.758241:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388553088:0@lo:400: 00000100:00100000:2.0:1788748286.758243:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553216 00000100:00100000:2.0:1788748286.758251:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553216 00000100:00100000:1.0:1788748286.758275:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748286.758303:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748286.758305:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748286.758312:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388552960:0@lo:400: 00000100:00100000:2.0:1788748286.758342:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388553216:12345-0@lo:400: 00000100:00100000:1.0:1788748286.758375:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.758408:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388553216:12345-0@lo:400: Request processed in 94us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748286.758410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553344 00000100:00100000:1.0:1788748286.758416:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553344 00000100:00100000:2.0:1788748286.758420:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788748286.758439:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552960 00000100:00100000:2.0:1788748286.758444:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552960 00000100:00100000:1.0:1788748286.758454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553088 00000100:00100000:1.0:1788748286.758459:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553088 00000100:00100000:3.0:1788748286.758748:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552832 00000100:00100000:3.0:1788748286.758752:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552832 00000100:00100000:3.0:1788748286.760300:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788748286.760348:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3636:x1875638388552832:12345-0@lo:400: 00000100:00100000:3.0:1788748286.760468:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3636:x1875638388552832:12345-0@lo:400: Request processed in 151us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748286.760476:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788748286.760751:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748286.760769:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388552960:12345-0@lo:400: 00000100:00100000:2.0:1788748286.760824:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388552960:12345-0@lo:400: Request processed in 62us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748286.760832:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748286.760912:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388552832:0@lo:400: 00000100:00100000:2.0:1788748286.762494:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388552704 00000100:00100000:2.0:1788748286.762510:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388552704 00000100:00100000:2.0:1788748286.762599:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748286.762611:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388552704:12345-0@lo:13: 00002000:00000024:2.0:1788748286.762643:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748286.762736:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388552704:12345-0@lo:13: Request processed in 127us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748286.762744:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748286.762781:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388553472:0@lo:400: 00000100:00100000:2.0:1788748286.762823:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.762878:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748286.762886:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388553600:0@lo:400: 00000100:00100000:2.0:1788748286.762910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748286.762938:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553472 00000100:00100000:2.0:1788748286.762942:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553472 00000100:00100000:2.0:1788748286.762971:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553600 00000100:00100000:2.0:1788748286.762975:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553600 00000100:00100000:2.0:1788748286.762992:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748286.762999:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388553472:12345-0@lo:400: 00000100:00100000:2.0:1788748286.763038:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388553472:12345-0@lo:400: Request processed in 39us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748286.763046:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748286.763058:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748286.763065:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388553600:12345-0@lo:400: 00000100:00100000:2.0:1788748286.763117:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388553600:12345-0@lo:400: Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748286.763124:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788748286.763167:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb392bb80 x1875638388553600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748286.763183:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388553600:0@lo:400: 00010000:00080000:2.0:1788748286.763196:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb3929c00 x1875638388553472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748286.763218:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388553472:0@lo:400: 00000100:00100000:1.0:1788748286.763228:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748286.763247:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388553344:12345-0@lo:400: 00000100:00100000:1.0:1788748286.763303:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388553344:12345-0@lo:400: Request processed in 64us (5166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748286.764346:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788748286.764372:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388553088:12345-0@lo:400: 00000100:00100000:3.0:1788748286.764446:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388553088:12345-0@lo:400: Request processed in 87us (6171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748286.764454:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788748286.764502:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748286.764508:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748286.764512:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788748286.764739:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adda73a0e00 x1875638388553216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748286.764755:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388553216:0@lo:400: 00010000:00080000:0.0:1788748286.764770:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb533ed80 x1875638388552704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748286.764778:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788748286.764803:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388552704:0@lo:13: 00010000:00080000:3.0:1788748286.765089:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adda73a3480 x1875638388552960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748286.765101:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388552960:0@lo:400: 00000100:00100000:3.0:1788748286.765112:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388553088:0@lo:400: 00000100:00100000:2.0:1788748286.765547:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388553344:0@lo:400: 00000100:00100000:1.0:1788748286.766703:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00000004:2.0:1788748286.930414:0:9005:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748286.930427:0:9005:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788748287.268805:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748288.292669:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748288.807454:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748288.807487:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388553728:0@lo:41: 00000100:00100000:3.0:1788748288.807584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748288.807749:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553728 00000100:00100000:2.0:1788748288.807760:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553728 00000100:00100000:2.0:1788748288.807823:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788748288.807834:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388553728:12345-0@lo:41: 00000004:00000024:2.0:1788748288.807888:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788748288.807942:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388553728:12345-0@lo:41: Request processed in 110us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748288.807949:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788748288.808085:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388553728:0@lo:41: 00010000:00010000:3.0:1788748289.319980:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748290.348392:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748290.853449:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748290.853478:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388553856:0@lo:41: 00000100:00100000:2.0:1788748290.853558:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748290.853632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553856 00000100:00100000:2.0:1788748290.853641:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553856 00000100:00100000:2.0:1788748290.853690:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788748290.853699:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388553856:12345-0@lo:41: 00000004:00000024:2.0:1788748290.853734:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788748290.853797:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388553856:12345-0@lo:41: Request processed in 98us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748290.853804:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748290.854650:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388553856:0@lo:41: 00010000:00010000:2.0:1788748291.364622:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748291.877098:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748291.877124:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388553984:0@lo:13: 00000100:00100000:2.0:1788748291.877187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.877268:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388553984 00000100:00100000:2.0:1788748291.877275:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388553984 00000100:00100000:2.0:1788748291.877413:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748291.877424:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388553984:12345-0@lo:13: 00002000:00000024:2.0:1788748291.877455:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748291.877499:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388553984:12345-0@lo:13: Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.877506:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788748291.877525:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788748291.877555:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb533d500 x1875638388553984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748291.877575:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388553984:0@lo:13: 00000100:00100000:3.0:1788748291.877884:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748291.877895:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388554112:0@lo:13: 00000100:00100000:3.0:1788748291.877930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748291.878876:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388554112 00000100:00100000:2.0:1788748291.878884:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388554112 00000100:00100000:2.0:1788748291.878935:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748291.878943:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388554112:12345-0@lo:13: 00002000:00000024:2.0:1788748291.878969:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748291.879022:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388554112:12345-0@lo:13: Request processed in 79us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748291.879029:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788748291.879067:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb392bb80 x1875638388554112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748291.879084:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388554112:0@lo:13: 00000100:00100000:2.0:1788748291.879181:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388554496:0@lo:400: 00000100:00080000:3.0:1788748291.879351:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748291.879378:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388554624:0@lo:400: 00000100:00100000:3.0:1788748291.879427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748291.879774:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388554240:0@lo:400: 00000100:00100000:0.0:1788748291.879809:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748291.879857:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388554752:0@lo:400: 00000100:00100000:0.0:1788748291.879881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748291.879900:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788748291.879904:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388554368:0@lo:400: 00000100:00100000:0.0:1788748291.879923:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748291.879941:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388554880:0@lo:400: 00000100:00100000:0.0:1788748291.880017:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748291.880049:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388554624 00000100:00100000:0.0:1788748291.880055:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388554624 00000100:00100000:0.0:1788748291.880085:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388554368 00000100:00100000:0.0:1788748291.880096:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388554368 00000100:00100000:0.0:1788748291.880110:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388554880 00000100:00100000:0.0:1788748291.880112:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388554880 00000100:00100000:0.0:1788748291.880134:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748291.880140:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388554624:12345-0@lo:400: 00000100:00100000:0.0:1788748291.880183:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388554624:12345-0@lo:400: Request processed in 42us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748291.880189:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748291.880590:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748291.880599:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388554368:12345-0@lo:400: 00000100:00100000:0.0:1788748291.880639:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388554368:12345-0@lo:400: Request processed in 42us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748291.880645:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748291.880656:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748291.880662:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388554880:12345-0@lo:400: 00010000:00080000:2.0:1788748291.881851:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb533c000 x1875638388554368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748291.881871:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388554368:0@lo:400: 00000100:00100000:0.0:1788748291.882173:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388554880:12345-0@lo:400: Request processed in 1509us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748291.882182:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748291.882776:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388554752 00000100:00100000:0.0:1788748291.882785:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388554752 00000100:00100000:0.0:1788748291.882838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748291.882845:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388554752:12345-0@lo:400: 00000100:00100000:0.0:1788748291.882891:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388554752:12345-0@lo:400: Request processed in 47us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748291.882897:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788748291.882938:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788748291.883183:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addb533ed80 x1875638388554624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788748291.883330:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adda73a0000 x1875638388554880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748291.883342:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388554880:0@lo:400: 00000100:00100000:2.0:1788748291.883355:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388554752:0@lo:400: 00000100:00100000:0.0:1788748291.883419:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388554624:0@lo:400: 00000100:00100000:0.0:1788748291.885939:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388554240 00000100:00100000:0.0:1788748291.886917:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388554240 00000100:00100000:0.0:1788748291.888810:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788748291.890391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748291.890438:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388555008:0@lo:400: 00000100:00100000:3.0:1788748291.890473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748291.890534:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388554496 00000100:00100000:3.0:1788748291.890543:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388554496 00000100:00100000:3.0:1788748291.890588:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788748291.890596:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388554496:12345-0@lo:400: 00000100:00100000:3.0:1788748291.890651:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388554496:12345-0@lo:400: Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748291.890658:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788748291.891165:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3635:x1875638388554240:12345-0@lo:400: 00000100:00100000:0.0:1788748291.891224:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3635:x1875638388554240:12345-0@lo:400: Request processed in 2404us (11414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748291.891232:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788748291.891295:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388554240:0@lo:400: 00000100:00100000:3.0:1788748291.895117:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388554496:0@lo:400: 00000100:00100000:1.0:1788748291.896656:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555008 00000100:00100000:1.0:1788748291.896679:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555008 00000100:00100000:1.0:1788748291.896755:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748291.896766:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388555008:12345-0@lo:400: 00000100:00100000:1.0:1788748291.896893:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388555008:12345-0@lo:400: Request processed in 129us (6418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748291.896902:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788748291.899112:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788748291.899218:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adda73a1f80 x1875638388555008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748291.899250:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388555008:0@lo:400: 00010000:00010000:3.0:1788748292.389061:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748293.412897:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748293.926430:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748293.926457:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388555136:0@lo:41: 00000100:00100000:3.0:1788748293.926527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748293.926593:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555136 00000100:00100000:3.0:1788748293.926601:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555136 00000100:00100000:3.0:1788748293.926643:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788748293.926652:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388555136:12345-0@lo:41: 00000004:00000024:3.0:1788748293.926683:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788748293.926725:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388555136:12345-0@lo:41: Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748293.926732:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788748293.926876:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388555136:0@lo:41: 00010000:00010000:2.0:1788748294.436730:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748295.460814:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748295.973220:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748295.973247:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388555264:0@lo:41: 00000100:00100000:0.0:1788748295.973313:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748295.974184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555264 00000100:00100000:0.0:1788748295.974194:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555264 00000100:00100000:0.0:1788748295.974244:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788748295.974253:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388555264:12345-0@lo:41: 00000004:00000024:0.0:1788748295.974288:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788748295.975179:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388555264:12345-0@lo:41: Request processed in 923us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748295.975188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788748295.976505:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388555264:0@lo:41: 00000020:01000004:2.0:1788748296.231525:0:9504:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788748296.231529:0:9504:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788748296.231531:0:9504:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788748296.231665:0:9504:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adc838be800 00000020:01000004:2.0:1788748296.231680:0:9504:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788748296.231694:0:9504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788748296.231708:0:9504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8addb538b380) 00000020:00000080:2.0:1788748296.231723:0:9504:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788748296.273543:0:9504:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788748296.273611:0:9504:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788748296.283888:0:9504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788748296.284177:0:9504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788748296.284190:0:9504:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788748296.284203:0:9504:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9ba0f20a02e19df8 00000020:01000004:0.0:1788748296.284215:0:9504:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788748296.284238:0:9504:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788748296.284242:0:9504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788748296.284248:0:9504:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788748296.284293:0:9504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788748296.284298:0:9504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788748296.302967:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788748296.303005:0:9504:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788748296.303010:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788748296.303011:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748296.303013:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748296.303014:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748296.303015:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748296.303016:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748296.303018:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748296.303020:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748296.303021:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748296.303023:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748296.303024:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748296.303028:0:9504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788748296.303030:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748296.303032:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748296.303033:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748296.303034:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748296.303035:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748296.303037:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748296.303037:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748296.303039:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748296.303040:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748296.303041:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748296.303042:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788748296.303069:0:9504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788748296.303087:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388555392:0@lo:253: 00000100:00100000:1.0:1788748296.303155:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748296.303210:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748296.304482:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555392 00000100:00100000:0.0:1788748296.304495:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555392 00000100:00100000:0.0:1788748296.304562:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788748296.304573:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:9504:x1875638388555392:12345-0@lo:253: 20000000:01000000:0.0:1788748296.304624:0:6503:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788748296.304628:0:6503:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788748296.304633:0:6503:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788748296.304637:0:6503:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788748296.304916:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748296.305052:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788748296.305068:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788748296.305087:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788748296.305093:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788748296.305107:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788748296.305125:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788748296.305223:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788748296.305239:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:0.0:1788748296.305241:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:0.0:1788748296.305267:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788748296.305275:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788748296.305293:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788748296.305301:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:0.0:1788748296.305350:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788748296.305359:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788748296.305376:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788748296.305403:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788748296.305480:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788748296.305493:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:0.0:1788748296.305495:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:0.0:1788748296.305524:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788748296.305532:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788748296.305545:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788748296.305551:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:0.0:1788748296.305562:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788748296.305567:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788748296.305576:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788748296.305590:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788748296.305939:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788748296.305952:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:0.0:1788748296.305954:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:0.0:1788748296.305971:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788748296.305978:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788748296.305995:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788748296.306002:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:0.0:1788748296.306014:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788748296.306019:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788748296.306030:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788748296.306044:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788748296.306056:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788748296.306058:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788748296.306062:0:6503:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788748296.306126:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788748296.306129:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788748296.307139:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788748296.307173:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788748296.307193:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788748296.307443:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788748296.307470:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788748296.307497:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788748296.307513:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788748296.307515:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788748296.308921:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788748296.308959:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788748296.308976:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788748296.309160:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788748296.309184:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788748296.309199:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1788748296.309209:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788748296.309211:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788748296.309602:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788748296.309621:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788748296.309635:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788748296.309773:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788748296.309804:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788748296.309823:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788748296.309832:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788748296.309834:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788748296.310147:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1788748296.310265:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1788748296.310284:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1788748296.310299:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1788748296.310306:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788748296.310308:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788748296.310960:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788748296.310995:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788748296.311011:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788748296.311280:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788748296.311307:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788748296.311444:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:1.0:1788748296.311467:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788748296.311488:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311506:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311514:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311522:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311530:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311537:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311551:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311558:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311566:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311605:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311621:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 21 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.311636:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388555520:0@lo:104: 00000100:00100000:1.0:1788748296.311702:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748296.311755:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.311764:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 21 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.311772:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388555648:0@lo:104: 00000100:00100000:2.0:1788748296.312752:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555520 00000100:00100000:2.0:1788748296.312761:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555520 00000100:00100000:2.0:1788748296.312820:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748296.312830:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388555520:12345-0@lo:104: 00010000:00010000:2.0:1788748296.312845:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.313375:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748296.313384:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388555520:12345-0@lo:104: Request processed in 556us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.313393:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788748296.314084:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748296.314095:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.314107:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748296.314111:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.314121:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748296.314141:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748296.314147:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748296.314194:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.314202:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748296.314270:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.314277:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940400/0x9ba0f20a02e19de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19dea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.314289:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748296.314291:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748296.314293:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748296.314301:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748296.314335:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388555776:0@lo:103: 00000100:00100000:3.0:1788748296.314389:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.314453:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555776 00000100:00100000:3.0:1788748296.314460:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555776 00000100:00100000:1.0:1788748296.314462:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748296.314486:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.314514:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748296.314524:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3635:x1875638388555776:12345-0@lo:103: 00010000:00010000:3.0:1788748296.314536:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748296.314543:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.314544:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.314561:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.314588:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388555904:0@lo:104: 00010000:00010000:3.0:1788748296.314589:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.314610:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748296.314621:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.314647:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3635:x1875638388555776:12345-0@lo:103: Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.314656:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748296.314819:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388555776:0@lo:103: 00010000:00010000:1.0:1788748296.316004:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.316018:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 21 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.316027:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556032:0@lo:104: 00000100:00100000:1.0:1788748296.316064:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.316089:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555648 00000100:00100000:2.0:1788748296.316096:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555648 00000100:00100000:0.0:1788748296.316148:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388555904 00000100:00100000:0.0:1788748296.316153:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388555904 00000100:00100000:0.0:1788748296.316181:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748296.316191:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6503:x1875638388555648:12345-0@lo:104: 00010000:00010000:0.0:1788748296.316203:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316252:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748296.316258:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6503:x1875638388555648:12345-0@lo:104: Request processed in 70us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.316265:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748296.316282:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748296.316300:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388555904:12345-0@lo:104: 00010000:00010000:0.0:1788748296.316308:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316370:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788748296.316375:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388555904:12345-0@lo:104: Request processed in 87us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.316381:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788748296.316399:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748296.316404:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316412:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f7200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:0.0:1788748296.316416:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316424:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748296.316432:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748296.316438:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748296.316466:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316473:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748296.316492:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316499:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f7200/0x9ba0f20a02e19db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19dc0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316522:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748296.316526:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316532:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77000 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:0.0:1788748296.316535:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316541:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748296.316548:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748296.316553:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748296.316565:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316570:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748296.316576:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316582:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e19d9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19da4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316592:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748296.316594:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748296.316596:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748296.316609:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388556160:0@lo:103: 00000100:00100000:0.0:1788748296.316645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.316673:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748296.316678:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388556288:0@lo:103: 00000100:00100000:0.0:1788748296.316694:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.316718:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556160 00000100:00100000:0.0:1788748296.316722:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556160 00010000:00010000:0.0:1788748296.316749:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 22 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748296.316767:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556288 00000100:00100000:0.0:1788748296.316770:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556288 00010000:00010000:0.0:1788748296.316781:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 23 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748296.316803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748296.316810:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:3637:x1875638388556160:12345-0@lo:103: 00010000:00010000:0.0:1788748296.316819:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748296.316823:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 23 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316832:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 23 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316848:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748296.316872:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:3637:x1875638388556160:12345-0@lo:103: Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.316878:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748296.316888:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748296.316894:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3637:x1875638388556288:12345-0@lo:103: 00010000:00010000:0.0:1788748296.316907:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748296.316911:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316920:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.316928:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748296.316948:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3637:x1875638388556288:12345-0@lo:103: Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.316953:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748296.316984:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388556288:0@lo:103: 00000100:00100000:0.0:1788748296.316993:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388556160:0@lo:103: 00010000:00010000:1.0:1788748296.317259:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.317270:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 21 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.317278:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556416:0@lo:104: 00000100:00100000:0.0:1788748296.317373:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556032 00000100:00100000:0.0:1788748296.317378:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556032 00000100:00100000:0.0:1788748296.317399:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748296.317405:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388556032:12345-0@lo:104: 00010000:00010000:0.0:1788748296.317413:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317448:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748296.317453:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388556032:12345-0@lo:104: Request processed in 50us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.317459:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788748296.317472:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748296.317477:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317494:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:0.0:1788748296.317498:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317505:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748296.317512:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748296.317518:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788748296.317532:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317538:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788748296.317554:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317561:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add8148a800/0x9ba0f20a02e19d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d7a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317572:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748296.317575:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748296.317577:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748296.317589:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388556544:0@lo:103: 00000100:00100000:0.0:1788748296.317617:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.317656:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556544 00000100:00100000:0.0:1788748296.317660:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556544 00010000:00010000:0.0:1788748296.317673:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748296.317697:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748296.317704:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add88432c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3635:x1875638388556544:12345-0@lo:103: 00010000:00010000:0.0:1788748296.317712:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748296.317716:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317724:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 22 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.317734:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748296.317759:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add88432c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3635:x1875638388556544:12345-0@lo:103: Request processed in 56us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.317765:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748296.317822:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388556544:0@lo:103: 00000100:00100000:1.0:1788748296.317896:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748296.317948:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.317957:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 21 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.317966:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556672:0@lo:104: 00000100:00100000:1.0:1788748296.317995:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748296.318013:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.318033:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 21 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.318041:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556800:0@lo:104: 00000100:00100000:1.0:1788748296.318061:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf4779c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788748296.318074:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e19dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19de3 expref: 21 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.318084:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388555520:0@lo:104: 00010000:00010000:1.0:1788748296.318098:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19dc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19db9 expref: 20 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.318108:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388555648:0@lo:104: 00010000:00010000:1.0:1788748296.318119:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e19da4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19d9d expref: 19 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.318128:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388555904:0@lo:104: 00010000:00010000:1.0:1788748296.318140:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940800/0x9ba0f20a02e19d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19d73 expref: 18 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.318150:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556032:0@lo:104: 00000100:00100000:2.0:1788748296.318228:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788748296.318246:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.318258:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556416 00000100:00100000:2.0:1788748296.318262:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556416 00000100:00100000:2.0:1788748296.318280:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556672 00000100:00100000:2.0:1788748296.318282:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556672 00000100:00100000:2.0:1788748296.318471:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556800 00000100:00100000:2.0:1788748296.318475:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556800 00000100:00100000:2.0:1788748296.318491:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748296.318497:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6503:x1875638388556416:12345-0@lo:104: 00010000:00010000:2.0:1788748296.318506:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.318596:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788748296.318603:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:6503:x1875638388556416:12345-0@lo:104: Request processed in 106us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.318610:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748296.318629:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748296.318638:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbcbb3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6503:x1875638388556672:12345-0@lo:104: 00010000:00010000:2.0:1788748296.318645:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.318679:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788748296.318685:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbcbb3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6503:x1875638388556672:12345-0@lo:104: Request processed in 50us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.318690:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748296.318717:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748296.318722:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388556800:12345-0@lo:104: 00010000:00010000:2.0:1788748296.318737:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.318765:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788748296.318769:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6503:x1875638388556800:12345-0@lo:104: Request processed in 48us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.318775:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788748296.319062:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788748296.319069:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319076:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a600 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748296.319082:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319091:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748296.319099:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748296.319105:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748296.319127:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319134:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748296.319148:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319154:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add8148a600/0x9ba0f20a02e19d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d5e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319171:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748296.319174:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319179:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fba00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748296.319182:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319189:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748296.319196:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748296.319201:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748296.319215:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319220:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748296.319234:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319240:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d1f expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319251:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748296.319254:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319270:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748296.319274:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319280:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748296.319286:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748296.319305:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748296.319342:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319348:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748296.319355:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319362:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e19cee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19cf5 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319379:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748296.319382:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748296.319384:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748296.319397:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388556928:0@lo:103: 00000100:00100000:2.0:1788748296.319435:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.319482:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388557184:0@lo:103: 00000100:00100000:2.0:1788748296.319504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.319539:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748296.319545:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388557056:0@lo:103: 00000100:00100000:3.0:1788748296.319559:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388556928 00000100:00100000:3.0:1788748296.319566:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388556928 00000100:00100000:2.0:1788748296.319567:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748296.319593:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 18 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748296.319596:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557184 00000100:00100000:2.0:1788748296.319602:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557184 00000100:00100000:3.0:1788748296.319615:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557056 00010000:00010000:2.0:1788748296.319620:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 19 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.319621:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557056 00010000:00010000:3.0:1788748296.319639:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 20 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748296.319642:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748296.319654:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:3636:x1875638388556928:12345-0@lo:103: 00000100:00100000:3.0:1788748296.319660:0:6496:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788748296.319665:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748296.319671:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 20 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.319682:0:6496:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788748296.319686:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 20 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319702:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748296.319738:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:3636:x1875638388556928:12345-0@lo:103: Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.319744:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748296.319758:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748296.319764:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:3638:x1875638388557184:12345-0@lo:103: 00010000:00010000:2.0:1788748296.319772:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748296.319776:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 19 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319784:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 19 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319814:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748296.319831:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388556928:0@lo:103: 00000100:00100000:2.0:1788748296.319846:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:3638:x1875638388557184:12345-0@lo:103: Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.319854:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748296.319868:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748296.319874:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3638:x1875638388557056:12345-0@lo:103: 00010000:00010000:2.0:1788748296.319881:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748296.319885:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 18 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319893:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 18 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319905:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319913:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319925:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319932:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319939:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319946:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319957:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813faa00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748296.319960:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319967:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319975:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.319984:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748296.320006:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3638:x1875638388557056:12345-0@lo:103: Request processed in 132us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.320011:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748296.320036:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388557056:0@lo:103: 00000100:00100000:2.0:1788748296.320043:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388557184:0@lo:103: 00010000:00010000:2.0:1788748296.320075:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748296.320080:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748296.320623:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e19d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19d57 expref: 17 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.320636:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556416:0@lo:104: 00010000:00010000:1.0:1788748296.320945:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76800/0x9ba0f20a02e19d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19d18 expref: 16 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.320966:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556672:0@lo:104: 00010000:00010000:1.0:1788748296.320979:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19cf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19cee expref: 15 pid: 6502 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.320988:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6503:1875638388556800:0@lo:104: 00010000:00010000:1.0:1788748296.321013:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.321020:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.321024:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.321028:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19dff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788748296.321039:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788748296.325216:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:9504:x1875638388555392:12345-0@lo:253: Request processed in 20636us (22051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.325230:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788748296.325453:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388555392:0@lo:253: 10000000:01000000:1.0:1788748296.325471:0:9504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788748296.325474:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788748296.325476:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748296.325478:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748296.325479:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788748296.325480:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748296.325581:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748296.325583:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748296.325584:0:9504:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788748296.325586:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748296.325587:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788748296.325626:0:9504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc838be800 from lustre-OST0001 10000000:01000000:1.0:1788748296.325657:0:9504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788748296.325660:0:9504:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788748296.325670:0:9504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8add9ea619c0 local copy 10000000:01000000:1.0:1788748296.325674:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788748296.325709:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.325720:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.325730:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748296.325747:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557312:0@lo:101: 00000100:00100000:1.0:1788748296.325801:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748296.325884:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748296.325927:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557312 00000100:00100000:0.0:1788748296.325996:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557312 00000100:00100000:0.0:1788748296.326073:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788748296.326082:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+14:9504:x1875638388557312:12345-0@lo:101: 00010000:00010000:0.0:1788748296.326095:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748296.326109:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941600/0x9ba0f20a02e19e0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19e06 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.326135:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941600/0x9ba0f20a02e19e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e06 expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.326154:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941600/0x9ba0f20a02e19e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e06 expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.326162:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941600, rc 0) 00000100:00100000:0.0:1788748296.326252:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557312:12345-0@lo:101: Request processed in 171us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.326259:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788748296.326417:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557312:0@lo:101: 00010000:00010000:2.0:1788748296.326431:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.326440:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748296.326544:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557440:0@lo:501: 00000100:00100000:2.0:1788748296.326574:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.326655:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748296.326778:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557440 00000100:00100000:0.0:1788748296.326783:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557440 00000100:00100000:0.0:1788748296.326825:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788748296.326832:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557440:12345-0@lo:501: 00000100:00100000:0.0:1788748296.326894:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557440:12345-0@lo:501: Request processed in 63us (320us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748296.326901:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788748296.327042:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557440:0@lo:501: 10000000:01000000:2.0:1788748296.327053:0:9504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788748296.327068:0:9504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788748296.327074:0:9504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327083:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327089:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327105:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788748296.327133:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc838be800 10000000:01000000:2.0:1788748296.327138:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788748296.327143:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788748296.327243:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788748296.327249:0:9504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788748296.327252:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788748296.327270:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327278:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327286:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748296.327386:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557568:0@lo:101: 00000100:00100000:2.0:1788748296.327425:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.327444:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122180 going to sleep for 11 seconds 00010000:00010000:2.0:1788748296.327460:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748296.327466:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327474:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813faa00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748296.327478:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.327502:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557568 00000100:00100000:3.0:1788748296.327509:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557568 00000100:00100000:3.0:1788748296.327539:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788748296.327550:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557568:12345-0@lo:101: 00010000:00010000:2.0:1788748296.327552:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.327562:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:00010000:2.0:1788748296.327562:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748296.327571:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748296.327575:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19e14 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327589:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327604:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748296.327622:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327629:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813faa00/0x9ba0f20a02e19e06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9ba0f20a02e19e0d expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.327632:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327648:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748296.327649:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327652:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748296.327656:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748296.327662:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76000, rc 0) 00000100:00100000:2.0:1788748296.327670:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748296.327688:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388557696:0@lo:103: 00000100:00100000:3.0:1788748296.327710:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:9504:x1875638388557568:12345-0@lo:101: Request processed in 161us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.327718:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788748296.327723:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.327765:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557696 00000100:00100000:2.0:1788748296.327770:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557696 00000100:00100000:2.0:1788748296.327811:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748296.327818:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3636:x1875638388557696:12345-0@lo:103: 00010000:00010000:2.0:1788748296.327825:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748296.327836:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc941600/0x9ba0f20a02e19e0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19e06 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.327846:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748296.328456:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3636:x1875638388557696:12345-0@lo:103: Request processed in 636us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.328464:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748296.328502:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557568:0@lo:101: 00010000:00010000:2.0:1788748296.328515:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748296.328524:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748296.328893:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557824:0@lo:501: 00000100:00100000:2.0:1788748296.328932:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.328973:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748296.329030:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557824 00000100:00100000:0.0:1788748296.329036:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557824 00000100:00100000:0.0:1788748296.329076:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788748296.329084:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557824:12345-0@lo:501: 00000100:00100000:3.0:1788748296.329485:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388557696:0@lo:103: 00000100:00100000:0.0:1788748296.329598:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557824:12345-0@lo:501: Request processed in 514us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.329606:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788748296.329721:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557824:0@lo:501: 00000100:00100000:2.0:1788748296.329855:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557952:0@lo:503: 00000100:00100000:2.0:1788748296.329892:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.329964:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748296.329998:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388557952 00000100:00100000:1.0:1788748296.330003:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388557952 00000100:00100000:1.0:1788748296.330043:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788748296.330052:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557952:12345-0@lo:503: 00000100:00100000:1.0:1788748296.330345:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388557952:12345-0@lo:503: Request processed in 294us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748296.330353:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788748296.330484:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388557952:0@lo:503: 00000040:00080000:2.0:1788748296.331081:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748296.331169:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558080:0@lo:502: 00000100:00100000:2.0:1788748296.331356:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.331445:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748296.331486:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558080 00000100:00100000:0.0:1788748296.331492:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558080 00000100:00100000:0.0:1788748296.331535:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788748296.331545:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388558080:12345-0@lo:502: 00000100:00100000:0.0:1788748296.331822:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388558080:12345-0@lo:502: Request processed in 279us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.331838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788748296.331906:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558080:0@lo:502: 00000040:00080000:2.0:1788748296.332120:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788748296.332146:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788748296.332159:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788748296.332172:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788748296.332184:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788748296.332195:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788748296.332297:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558208:0@lo:502: 00000100:00100000:2.0:1788748296.332368:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.332405:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748296.332464:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558208 00000100:00100000:1.0:1788748296.332470:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558208 00000100:00100000:1.0:1788748296.332506:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788748296.332513:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388558208:12345-0@lo:502: 00000100:00100000:1.0:1788748296.332670:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388558208:12345-0@lo:502: Request processed in 157us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748296.332686:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788748296.332830:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558208:0@lo:502: 00000040:00080000:2.0:1788748296.332874:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788748296.332882:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788748296.333391:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748296.333399:0:9516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788748296.333405:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748296.333407:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788748296.333414:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748296.333437:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8adc83b10000) 00000020:00000080:1.0:1788748296.333464:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788748296.333471:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748296.333535:0:9516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc838be800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788748296.333543:0:9516:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788748296.333549:0:9516:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9ba0f20a02e19e29 00010000:00010000:0.0:1788748296.339014:0:9516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788748296.339486:0:9516:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788748296.342888:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788748296.343235:0:9516:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788748296.347009:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788748296.347177:0:9516:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788748296.353289:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788748296.356500:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788748296.356513:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748296.356519:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748296.356522:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788748296.356526:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748296.356531:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748296.356532:0:9516:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788748296.356535:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788748296.356537:0:9516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788748296.356571:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748296.356574:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748296.356576:0:9516:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788748296.356579:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788748296.356820:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788748296.356850:0:9504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788748296.356871:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.356884:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748296.356893:0:9504:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc838be800 from 1 10000000:01000000:0.0:1788748296.356896:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748296.356938:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.356946:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.356958:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748296.356983:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558336:0@lo:101: 00000100:00100000:0.0:1788748296.357050:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.357615:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777540 going to sleep for 11 seconds 00000100:00100000:1.0:1788748296.358665:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558336 00000100:00100000:1.0:1788748296.358678:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558336 00000100:00100000:1.0:1788748296.358739:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788748296.358749:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:9504:x1875638388558336:12345-0@lo:101: 00010000:00010000:1.0:1788748296.358765:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748296.358782:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19e30 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.358818:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.358829:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.358838:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813fac00, rc 0) 00000100:00100000:1.0:1788748296.358904:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:9504:x1875638388558336:12345-0@lo:101: Request processed in 157us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748296.358911:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788748296.359068:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558336:0@lo:101: 00010000:00010000:0.0:1788748296.359086:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.359096:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748296.359197:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558464:0@lo:501: 00000100:00100000:0.0:1788748296.359231:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.359258:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777540 going to sleep for 11 seconds 00000100:00100000:1.0:1788748296.359312:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558464 00000100:00100000:1.0:1788748296.359343:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558464 00000100:00100000:1.0:1788748296.359371:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788748296.359378:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:9504:x1875638388558464:12345-0@lo:501: 00000100:00100000:1.0:1788748296.359476:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:9504:x1875638388558464:12345-0@lo:501: Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.359587:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558464:0@lo:501: 00000100:00100000:2.0:1788748296.359616:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558592:0@lo:503: 00000100:00100000:2.0:1788748296.359656:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.359673:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748296.359687:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558592 00000100:00100000:2.0:1788748296.359691:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558592 00000100:00100000:2.0:1788748296.359710:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788748296.359717:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388558592:12345-0@lo:503: 00000100:00100000:2.0:1788748296.359801:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388558592:12345-0@lo:503: Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.359809:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788748296.359849:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558592:0@lo:503: 00000040:00080000:2.0:1788748296.360055:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748296.360111:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558720:0@lo:502: 00000100:00100000:2.0:1788748296.360145:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.360159:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86122840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748296.360179:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558720 00000100:00100000:2.0:1788748296.360183:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558720 00000100:00100000:2.0:1788748296.360201:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788748296.360207:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388558720:12345-0@lo:502: 00000100:00100000:2.0:1788748296.360278:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388558720:12345-0@lo:502: Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.360286:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788748296.360346:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558720:0@lo:502: 00000100:00100000:1.0:1788748296.360880:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000040:00080000:2.0:1788748296.361302:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788748296.361372:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788748296.361402:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558848:0@lo:502: 00000100:00100000:2.0:1788748296.361449:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.361554:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9e6e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748296.361844:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558848 00000100:00100000:3.0:1788748296.361851:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558848 00000100:00100000:3.0:1788748296.361888:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788748296.361896:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:9504:x1875638388558848:12345-0@lo:502: 00000100:00100000:3.0:1788748296.361999:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:9504:x1875638388558848:12345-0@lo:502: Request processed in 103us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.362006:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788748296.362122:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558848:0@lo:502: 00000040:00080000:2.0:1788748296.362165:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788748296.362173:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788748296.362633:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748296.362642:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748296.362645:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788748296.362651:0:9520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc838be800 00000020:00000080:2.0:1788748296.362653:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788748296.362663:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748296.362665:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748296.362667:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788748296.362669:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788748296.363365:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788748296.363394:0:9504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748296.363421:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.363434:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748296.363648:0:9504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788748296.363656:0:9504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc838be800 10000000:01000000:3.0:1788748296.363660:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc838be800 10000000:01000000:3.0:1788748296.363663:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748296.363669:0:9504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc838be800 from 1 10000000:01000000:3.0:1788748296.363672:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748296.363705:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.363713:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.363722:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.363741:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558976:0@lo:101: 00000100:00100000:3.0:1788748296.363805:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.363950:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748296.365433:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388558976 00000100:00100000:1.0:1788748296.365445:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388558976 00000100:00100000:1.0:1788748296.366287:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788748296.366300:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:9504:x1875638388558976:12345-0@lo:101: 00010000:00010000:1.0:1788748296.366351:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748296.366370:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19e3e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.366398:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.366409:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.366417:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813faa00, rc 0) 00000100:00100000:1.0:1788748296.366495:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388558976:12345-0@lo:101: Request processed in 199us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748296.366503:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788748296.366684:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388558976:0@lo:101: 00010000:00010000:3.0:1788748296.366703:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.366713:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.366833:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559104:0@lo:501: 00000100:00100000:3.0:1788748296.366871:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.366902:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748296.367019:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388559104 00000100:00100000:1.0:1788748296.367026:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388559104 00000100:00100000:1.0:1788748296.367063:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788748296.367070:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559104:12345-0@lo:501: 00000100:00100000:1.0:1788748296.367179:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559104:12345-0@lo:501: Request processed in 109us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748296.367186:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788748296.367273:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559104:0@lo:501: 00000100:00100000:3.0:1788748296.367301:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559232:0@lo:503: 00000100:00100000:3.0:1788748296.367382:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.367405:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748296.367477:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388559232 00000100:00100000:0.0:1788748296.367492:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388559232 00000100:00100000:0.0:1788748296.367517:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788748296.367523:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559232:12345-0@lo:503: 00000100:00100000:0.0:1788748296.367608:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559232:12345-0@lo:503: Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.367614:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788748296.367741:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559232:0@lo:503: 00000040:00080000:3.0:1788748296.367982:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748296.368046:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559360:0@lo:502: 00000100:00100000:3.0:1788748296.368081:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.368112:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748296.368273:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388559360 00000100:00100000:1.0:1788748296.368278:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388559360 00000100:00100000:1.0:1788748296.368309:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788748296.368339:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559360:12345-0@lo:502: 00000100:00100000:1.0:1788748296.368423:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559360:12345-0@lo:502: Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748296.368431:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788748296.368527:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559360:0@lo:502: 00000040:00080000:3.0:1788748296.368731:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788748296.368757:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788748296.368771:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788748296.368783:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788748296.368828:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788748296.368842:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788748296.368854:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788748296.368866:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788748296.368880:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788748296.368895:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788748296.368909:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788748296.368924:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788748296.368939:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788748296.368954:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788748296.368976:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788748296.368992:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788748296.369007:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788748296.369022:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788748296.369034:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788748296.369046:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788748296.369058:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788748296.369073:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788748296.369096:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788748296.369111:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788748296.369125:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788748296.369149:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788748296.369162:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788748296.369173:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788748296.369184:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788748296.369196:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788748296.369209:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788748296.369220:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788748296.369232:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788748296.369244:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788748296.369255:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788748296.369266:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788748296.369277:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788748296.369288:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788748296.369298:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788748296.369308:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788748296.369362:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788748296.369386:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788748296.369399:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788748296.369411:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788748296.369422:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788748296.369433:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788748296.369454:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559488:0@lo:502: 00000100:00100000:3.0:1788748296.369497:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.369523:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748296.369821:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388559488 00000100:00100000:0.0:1788748296.369827:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388559488 00000100:00100000:0.0:1788748296.369861:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788748296.369869:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559488:12345-0@lo:502: 00000100:00100000:0.0:1788748296.369965:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388559488:12345-0@lo:502: Request processed in 97us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.369972:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788748296.370414:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388559488:0@lo:502: 00000040:00080000:3.0:1788748296.370464:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788748296.370474:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788748296.371265:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788748296.371288:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8adc825d3380) 00000020:00000080:3.0:1788748296.371311:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788748296.371403:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc838be800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788748296.371407:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc838be800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788748296.371409:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc838be800 3 00010000:00080000:3.0:1788748296.371433:0:9521:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc83d29000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788748296.373695:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788748296.373901:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788748296.373946:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788748296.373957:0:9521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9ba0f20a02e19e53 00000100:00080000:3.0:1788748296.373968:0:9521:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748296.373980:0:9521:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc83d29000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748296.374015:0:9521:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8addbc838380 x1875638388559616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748296.374042:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788748296.374248:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388559616:0@lo:38: 00000100:00100000:0.0:1788748296.374358:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374361:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388560128:0@lo:400: 00000100:00100000:2.0:1788748296.374401:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.374427:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388559616 00000100:00100000:2.0:1788748296.374429:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388560640:0@lo:400: 00000100:00100000:0.0:1788748296.374443:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388559616 00000100:00100000:2.0:1788748296.374453:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374474:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748296.374491:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388559744:0@lo:400: 00000100:00100000:2.0:1788748296.374511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374527:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388560256:0@lo:400: 00000100:00100000:2.0:1788748296.374544:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374568:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388559872:0@lo:400: 00000100:00100000:2.0:1788748296.374598:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374616:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388560384:0@lo:400: 00000100:00100000:2.0:1788748296.374635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374647:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788748296.374652:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388560000:0@lo:400: 00000100:00100000:2.0:1788748296.374671:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374681:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388560512:0@lo:400: 00000100:00100000:2.0:1788748296.374699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.374726:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560128 00000100:00100000:2.0:1788748296.374730:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560128 00000100:00100000:2.0:1788748296.374759:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388559872 00000100:00100000:2.0:1788748296.374763:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388559872 00000100:00100000:2.0:1788748296.374778:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748296.374785:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388560128:12345-0@lo:400: 00000100:00100000:2.0:1788748296.374845:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388560128:12345-0@lo:400: Request processed in 59us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.374852:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748296.374867:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748296.374873:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388559872:12345-0@lo:400: 00000100:00100000:2.0:1788748296.374901:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388559872:12345-0@lo:400: Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.374907:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748296.374923:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560640 00000100:00100000:2.0:1788748296.374926:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560640 00000100:00100000:2.0:1788748296.374956:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560512 00000100:00100000:2.0:1788748296.374959:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560512 00000100:00100000:2.0:1788748296.374976:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748296.374982:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388560640:12345-0@lo:400: 00000100:00100000:2.0:1788748296.375018:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388560640:12345-0@lo:400: Request processed in 37us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.375025:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748296.375036:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748296.375042:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388560512:12345-0@lo:400: 00000100:00100000:2.0:1788748296.375068:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388560512:12345-0@lo:400: Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.375073:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748296.375089:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388559744 00000100:00100000:2.0:1788748296.375093:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388559744 00000100:00100000:2.0:1788748296.375107:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560256 00000100:00100000:2.0:1788748296.375110:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560256 00000100:00100000:2.0:1788748296.375120:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560384 00000100:00100000:2.0:1788748296.375122:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560384 00000100:00100000:2.0:1788748296.375132:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560000 00000100:00100000:2.0:1788748296.375133:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560000 00000100:00100000:2.0:1788748296.375143:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748296.375148:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388559744:12345-0@lo:400: 00000100:00100000:2.0:1788748296.375176:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388559744:12345-0@lo:400: Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.375181:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748296.375192:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748296.375198:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388560256:12345-0@lo:400: 00000100:00100000:2.0:1788748296.375222:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388560256:12345-0@lo:400: Request processed in 25us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.375227:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748296.375237:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748296.375244:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748296.375252:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875638388559616:12345-0@lo:38: 00000100:00100000:0.0:1788748296.375254:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388560384:12345-0@lo:400: 00010000:00080000:2.0:1788748296.375281:0:8447:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000100:00100000:0.0:1788748296.375297:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388560384:12345-0@lo:400: Request processed in 51us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.375305:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:2.0:1788748296.375336:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9ba0f20a02e19e5a 00000100:00100000:0.0:1788748296.375347:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000004:00100000:2.0:1788748296.375352:0:8447:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788748296.375358:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388560000:12345-0@lo:400: 00000100:00080000:2.0:1788748296.375383:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8adc838bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748296.375395:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388560000:12345-0@lo:400: Request processed in 41us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.375402:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788748296.375444:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875638388559616:12345-0@lo:38: Request processed in 192us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.375452:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788748296.375485:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748296.375489:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748296.375491:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788748296.375531:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addbc838380 x1875638388559616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.375541:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748296.375549:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788748296.375556:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788748296.375561:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788748296.375563:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748296.375569:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388559616:0@lo:38: 00010000:00080000:2.0:1788748296.375596:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc83b08380 x1875638388560000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.375604:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388560000:0@lo:400: 00010000:00080000:2.0:1788748296.375614:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc83b0b800 x1875638388560512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.375622:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388560512:0@lo:400: 00000100:00100000:2.0:1788748296.375630:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388559872:0@lo:400: 00010000:00080000:2.0:1788748296.375650:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc83b0a300 x1875638388560384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.375658:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388560384:0@lo:400: 00010000:00080000:2.0:1788748296.375686:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc83b08700 x1875638388559744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.375694:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388559744:0@lo:400: 00010000:00080000:2.0:1788748296.375703:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc83b08e00 x1875638388560256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.375710:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388560256:0@lo:400: 00000100:00100000:2.0:1788748296.375720:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388560128:0@lo:400: 00010000:00080000:2.0:1788748296.375729:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc83b0b480 x1875638388560640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.375736:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388560640:0@lo:400: 00000020:01000004:3.0:1788748296.379379:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:0.0:1788748296.379427:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9522:1875638388560768:0@lo:901: 00000020:00000080:3.0:1788748296.379531:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8adc825d0000) 00000020:00000080:3.0:1788748296.379557:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:0.0:1788748296.379575:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748296.379626:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560768 00000100:00100000:0.0:1788748296.379634:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560768 00000020:01000004:3.0:1788748296.379649:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc838be800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788748296.379655:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc838be800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788748296.379659:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc838be800 3 00000100:00100000:0.0:1788748296.379705:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748296.379716:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9522:x1875638388560768:12345-0@lo:901: 00000100:00100000:0.0:1788748296.379815:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9522:x1875638388560768:12345-0@lo:901: Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00080000:2.0:1788748296.379819:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788748296.380132:0:9521:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc83e56800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.122@tcp at head 00000100:00100000:0.0:1788748296.380577:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748296.380607:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777540 going to sleep for 11 seconds 00010000:00080000:0.0:1788748296.380637:0:9522:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc82fdc700 x1875638388560768/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788748312 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748296.380650:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9522:1875638388560768:0@lo:901: 00010000:00010000:3.0:1788748296.386199:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1788748296.386405:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788748296.386449:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788748296.386460:0:9521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9ba0f20a02e19e68 00000100:00080000:3.0:1788748296.386470:0:9521:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748296.386481:0:9521:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8adc83e56800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748296.386515:0:9521:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8addbc838e00 x1875638388560896/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748296.386547:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788748296.386874:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875638388560896:0@lo:38: 00000100:00100000:2.0:1788748296.386943:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788748296.387456:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:0.0:1788748296.388597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388560896 00000100:00100000:0.0:1788748296.388608:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388560896 00000100:00100000:0.0:1788748296.388662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748296.388669:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875638388560896:12345-0@lo:38: 00010000:00080000:0.0:1788748296.388696:0:6512:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:01000000:1.0:1788748296.389125:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788748296.389163:0:9504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748296.389180:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748296.389191:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788748296.389240:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788748296.389242:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748296.389243:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748296.389245:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748296.389246:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748296.389247:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748296.389248:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748296.389250:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748296.389251:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748296.389252:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748296.389254:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748296.389257:0:9504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788748296.389259:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788748296.389265:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788748296.389266:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788748296.389267:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788748296.389267:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788748296.389268:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788748296.389269:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788748296.389270:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788748296.389271:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788748296.389272:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788748296.389273:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788748296.389293:0:9504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788748296.389309:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388561024:0@lo:253: 00000100:00100000:1.0:1788748296.389387:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748296.389424:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477480 going to sleep for 11 seconds 00000020:00000080:0.0:1788748296.389587:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9ba0f20a02e19e6f 00000004:00100000:0.0:1788748296.389601:0:6512:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788748296.389632:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8addbf46b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748296.389695:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875638388560896:12345-0@lo:38: Request processed in 1025us (2752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.389703:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788748296.389973:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8addbc838e00 x1875638388560896/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748296.389984:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748296.389992:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788748296.389998:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788748296.390003:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788748296.390005:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc83e56800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788748296.390011:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875638388560896:0@lo:38: 00000100:00100000:3.0:1788748296.390366:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561024 00000100:00100000:3.0:1788748296.390372:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561024 00000100:00100000:3.0:1788748296.390409:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788748296.390417:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:9504:x1875638388561024:12345-0@lo:253: 20000000:01000000:3.0:1788748296.390439:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788748296.390452:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788748296.403310:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788748296.403343:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788748296.403402:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788748296.403406:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788748296.403427:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.403446:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.403455:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.403481:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.403519:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.403533:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 17 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.403547:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388561152:0@lo:104: 00000100:00100000:3.0:1788748296.403610:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748296.404459:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.404471:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 17 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.404482:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388561280:0@lo:104: 00000100:00100000:3.0:1788748296.404517:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.404536:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25840 going to sleep for 11 seconds 00000100:00100000:3.0:1788748296.404560:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561152 00000100:00100000:3.0:1788748296.404567:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561152 00000100:00100000:3.0:1788748296.404604:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561280 00000100:00100000:3.0:1788748296.404606:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561280 00000100:00100000:3.0:1788748296.404621:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748296.404629:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6526:x1875638388561152:12345-0@lo:104: 00010000:00010000:3.0:1788748296.404642:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.404751:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748296.404758:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:6526:x1875638388561152:12345-0@lo:104: Request processed in 130us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.404765:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748296.404784:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748296.404802:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388561280:12345-0@lo:104: 00010000:00010000:3.0:1788748296.404810:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.404849:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788748296.404864:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:6526:x1875638388561280:12345-0@lo:104: Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.404870:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788748296.404895:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748296.404901:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.404909:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748296.404913:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.404922:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748296.404930:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748296.404936:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748296.404971:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.404978:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748296.404996:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405003:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19db2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405018:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748296.405021:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405026:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748296.405029:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405036:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748296.405041:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748296.405046:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788748296.405060:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405066:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748296.405081:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405098:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add8148ba00/0x9ba0f20a02e19d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d6c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405112:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748296.405113:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748296.405115:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748296.405123:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748296.405135:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388561408:0@lo:103: 00000100:00100000:3.0:1788748296.405750:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748296.405831:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561408 00000100:00100000:3.0:1788748296.405837:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561408 00010000:00010000:3.0:1788748296.405860:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 18 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.405886:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748296.405893:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3636:x1875638388561408:12345-0@lo:103: 00010000:00010000:3.0:1788748296.405905:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748296.405910:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 18 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.405920:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 18 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748296.405922:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:9504:x1875638388561024:12345-0@lo:253: Request processed in 15504us (16532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.405931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:3.0:1788748296.405938:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748296.405966:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3636:x1875638388561408:12345-0@lo:103: Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.405972:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748296.405987:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:27ab3bfa-63dd-419e-978e-87fcee7a537d:9504:1875638388561024:0@lo:253: 00000100:00100000:3.0:1788748296.405989:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:2.0:1788748296.405998:0:9504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000100:00100000:3.0:1788748296.406004:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388561536:0@lo:103: 00000020:01000004:2.0:1788748296.406005:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748296.406007:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788748296.406008:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748296.406009:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748296.406010:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748296.406011:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748296.406013:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748296.406014:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788748296.406015:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788748296.406017:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748296.406018:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788748296.406026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:2.0:1788748296.406031:0:9504:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788748296.406049:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561536 00000100:00100000:3.0:1788748296.406052:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561536 00010000:00010000:3.0:1788748296.406066:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 17 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748296.406086:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748296.406091:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3638:x1875638388561536:12345-0@lo:103: 00010000:00010000:3.0:1788748296.406099:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748296.406102:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 17 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406110:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 17 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406121:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406128:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788748296.406141:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004525569s 00010000:00010000:3.0:1788748296.406145:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406641:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406648:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406665:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406671:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748296.406676:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406684:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406695:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748296.406707:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748296.406752:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3638:x1875638388561536:12345-0@lo:103: Request processed in 659us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748296.406759:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748296.406813:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388561536:0@lo:103: 00000100:00100000:3.0:1788748296.406835:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388561408:0@lo:103: 00010000:00010000:0.0:1788748296.407008:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e19db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19dab expref: 16 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748296.407019:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc838e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388561152:0@lo:104: 00010000:00010000:0.0:1788748296.407029:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add8148aa00/0x9ba0f20a02e19d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19d65 expref: 15 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748296.407037:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875638388561280:0@lo:104: 00010000:00010000:0.0:1788748296.407110:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.407120:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.407126:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748296.407133:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77200/0x9ba0f20a02e19e76 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788748296.412345:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788748296.412507:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788748296.412682:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788748296.413399:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788748296.413992:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788748296.414235:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788748296.418116:0:9504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788748296.433585:0:9504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788748296.433596:0:9504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788748296.433634:0:9504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788748296.433678:0:9504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788748296.433699:0:9504:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788748296.433729:0:9504:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788748296.434851:0:9504:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748296.435111:0:9504:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788748296.484441:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748296.997747:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388561792:0@lo:13: 00000100:00100000:3.0:1788748296.997831:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.998291:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561792 00000100:00100000:2.0:1788748296.998301:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561792 00000100:00100000:2.0:1788748296.998372:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748296.998382:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388561792:12345-0@lo:13: 00002000:00000024:2.0:1788748296.998414:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748296.998471:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388561792:12345-0@lo:13: Request processed in 91us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748296.998577:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748296.998589:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388561664:0@lo:13: 00000100:00100000:0.0:1788748296.998620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748296.998774:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748296.998800:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561664 00000100:00100000:2.0:1788748296.998804:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561664 00000100:00100000:2.0:1788748296.998820:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748296.998825:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388561664:12345-0@lo:13: 00002000:00000024:2.0:1788748296.998836:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748296.998876:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388561664:12345-0@lo:13: Request processed in 51us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748296.998882:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788748296.998923:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc839500 x1875638388561792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748296.998941:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388561792:0@lo:13: 00010000:00080000:0.0:1788748296.999012:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb392b480 x1875638388561664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748296.999024:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388561664:0@lo:13: 00000020:00000004:2.0:1788748297.395759:0:9577:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748297.395993:0:9577:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788748297.509697:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748298.532425:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748299.049673:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748299.049697:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388561920:0@lo:41: 00000100:00100000:2.0:1788748299.049762:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748299.049840:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388561920 00000100:00100000:2.0:1788748299.049848:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388561920 00000100:00100000:2.0:1788748299.049895:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788748299.049903:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388561920:12345-0@lo:41: 00000004:00000024:2.0:1788748299.049937:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788748299.049983:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388561920:12345-0@lo:41: Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748299.049989:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788748299.050035:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388561920:0@lo:41: 00010000:00010000:2.0:1788748299.560130:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748300.581562:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748301.092473:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388562048:0@lo:41: 00000100:00100000:1.0:1788748301.092543:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748301.092646:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562048 00000100:00100000:2.0:1788748301.092654:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562048 00000100:00100000:2.0:1788748301.092715:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788748301.092725:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388562048:12345-0@lo:41: 00000004:00000024:2.0:1788748301.092756:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788748301.095767:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388562048:12345-0@lo:41: Request processed in 2958us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748301.095782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748301.095898:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388562048:0@lo:41: 00010000:00010000:2.0:1788748301.604461:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748301.610951:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388562176:0@lo:400: 00000100:00100000:0.0:1788748301.611025:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611079:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388562688:0@lo:400: 00000100:00100000:0.0:1788748301.611103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611121:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388563200:0@lo:400: 00000100:00100000:0.0:1788748301.611138:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611160:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788748301.611166:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388562560:0@lo:400: 00000100:00100000:0.0:1788748301.611187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611203:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388563072:0@lo:400: 00000100:00100000:0.0:1788748301.611223:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611256:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388562304:0@lo:400: 00000100:00100000:0.0:1788748301.611278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611291:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388562816:0@lo:400: 00000100:00100000:0.0:1788748301.611309:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611339:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388563328:0@lo:400: 00000100:00100000:0.0:1788748301.611363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611374:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788748301.611379:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388562432:0@lo:400: 00000100:00100000:0.0:1788748301.611398:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611414:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388562944:0@lo:400: 00000100:00100000:0.0:1788748301.611433:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748301.611461:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562176 00000100:00100000:0.0:1788748301.611469:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562176 00000100:00100000:0.0:1788748301.611513:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788748301.611521:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3638:x1875638388562176:12345-0@lo:400: 00000100:00100000:0.0:1788748301.611568:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3638:x1875638388562176:12345-0@lo:400: Request processed in 47us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748301.611575:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788748301.611604:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562688 00000100:00100000:0.0:1788748301.611607:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562688 00000100:00100000:0.0:1788748301.612816:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563200 00000100:00100000:0.0:1788748301.613776:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563200 00000100:00100000:0.0:1788748301.613822:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562560 00000100:00080000:2.0:1788748301.613924:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748301.613960:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562560 00000100:00100000:0.0:1788748301.613978:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562304 00000100:00100000:0.0:1788748301.613981:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562304 00000100:00100000:0.0:1788748301.613992:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562816 00000100:00100000:0.0:1788748301.613995:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562816 00000100:00100000:0.0:1788748301.614449:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563328 00000100:00100000:0.0:1788748301.614455:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563328 00000100:00080000:2.0:1788748301.623719:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748301.627571:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563072 00000100:00100000:2.0:1788748301.627594:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563072 00000100:00100000:2.0:1788748301.627799:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562944 00000100:00100000:2.0:1788748301.627803:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562944 00000100:00100000:2.0:1788748301.627839:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748301.627849:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388563072:12345-0@lo:400: 00000100:00100000:2.0:1788748301.627946:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388563072:12345-0@lo:400: Request processed in 98us (16720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748301.627952:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748301.627970:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748301.627975:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388562944:12345-0@lo:400: 00000100:00100000:2.0:1788748301.628014:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388562944:12345-0@lo:400: Request processed in 39us (16580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748301.628020:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748301.628041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388562432 00000100:00100000:2.0:1788748301.628045:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388562432 00000100:00100000:2.0:1788748301.628070:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788748301.628076:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388562432:12345-0@lo:400: 00000100:00100000:2.0:1788748301.628109:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388562432:12345-0@lo:400: Request processed in 34us (16710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748301.628116:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788748301.628141:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788748301.628176:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bed80 x1875638388563072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748301.628191:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388563072:0@lo:400: 00000100:00100000:2.0:1788748301.628202:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388562176:0@lo:400: 00000100:00100000:0.0:1788748301.628363:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388562432:0@lo:400: 00010000:00080000:0.0:1788748301.628377:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840be680 x1875638388562944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748301.628388:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388562944:0@lo:400: 00000100:00100000:1.0:1788748301.628404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788748301.628416:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388562688:12345-0@lo:400: 00000100:00100000:0.0:1788748301.628436:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788748301.628457:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388563200:12345-0@lo:400: 00000100:00100000:1.0:1788748301.628462:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388562688:12345-0@lo:400: Request processed in 47us (17354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748301.628470:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788748301.628489:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788748301.628498:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388562560:12345-0@lo:400: 00000100:00100000:0.0:1788748301.628507:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388563200:12345-0@lo:400: Request processed in 62us (17367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748301.628515:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788748301.628544:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388562560:12345-0@lo:400: Request processed in 49us (17355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748301.628845:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748301.628855:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388562304:12345-0@lo:400: 00000100:00100000:0.0:1788748301.628896:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388562304:12345-0@lo:400: Request processed in 44us (17617us total) trans 0 rc 0/0 00010000:00080000:2.0:1788748301.628973:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdea00 x1875638388562560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748301.628997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388562560:0@lo:400: 00010000:00080000:2.0:1788748301.629011:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdce00 x1875638388562688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748301.629018:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388562688:0@lo:400: 00010000:00080000:2.0:1788748301.629028:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bc700 x1875638388563200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748301.629036:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388563200:0@lo:400: 00000100:00100000:1.0:1788748301.632116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788748301.632160:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788748301.632383:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fddf80 x1875638388562304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748301.632402:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388562304:0@lo:400: 00000100:00100000:1.0:1788748301.632465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748301.632484:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388562816:12345-0@lo:400: 00000100:00100000:1.0:1788748301.632588:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388562816:12345-0@lo:400: Request processed in 113us (21277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748301.632603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748301.632804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748301.632813:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388563328:12345-0@lo:400: 00000100:00100000:1.0:1788748301.632858:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388563328:12345-0@lo:400: Request processed in 46us (21494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748301.632864:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788748301.635827:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bd180 x1875638388562816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748301.635845:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388562816:0@lo:400: 00010000:00080000:0.0:1788748301.635861:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bca80 x1875638388563328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748301.635871:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388563328:0@lo:400: 00000100:00100000:0.0:1788748302.116630:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388563456:0@lo:13: 00000100:00100000:0.0:1788748302.116704:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748302.116858:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563456 00000100:00100000:0.0:1788748302.116866:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563456 00000100:00100000:0.0:1788748302.116911:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788748302.116925:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388563456:12345-0@lo:13: 00002000:00000024:0.0:1788748302.116956:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748302.117014:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388563456:12345-0@lo:13: Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748302.117021:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748302.117305:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748302.117346:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388563584:0@lo:13: 00000100:00100000:2.0:1788748302.117381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788748302.117506:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3928000 x1875638388563456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748302.117526:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388563456:0@lo:13: 00000100:00100000:1.0:1788748302.117591:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563584 00000100:00100000:1.0:1788748302.117597:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563584 00000100:00100000:1.0:1788748302.117633:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748302.117641:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388563584:12345-0@lo:13: 00002000:00000024:1.0:1788748302.117655:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748302.117694:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388563584:12345-0@lo:13: Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748302.117700:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788748302.117732:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b09880 x1875638388563584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748302.117744:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388563584:0@lo:13: 00010000:00010000:2.0:1788748302.633872:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748302.719212:0:9867:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1788748303.497943:0:9919:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748303.499427:0:9919:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788748303.661509:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748304.168753:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748304.168865:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388563712:0@lo:41: 00000100:00100000:1.0:1788748304.168934:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748304.168998:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563712 00000100:00100000:1.0:1788748304.169006:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563712 00000100:00100000:1.0:1788748304.169049:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788748304.169057:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388563712:12345-0@lo:41: 00000004:00000024:1.0:1788748304.169683:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788748304.169755:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388563712:12345-0@lo:41: Request processed in 697us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748304.169769:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788748304.169825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388563712:0@lo:41: 00010000:00010000:2.0:1788748304.677087:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748305.701653:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748306.220058:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788748306.220070:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8addb53d9000 from 39 10000000:01000000:3.0:1788748306.220078:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748306.220147:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748306.220161:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748306.220175:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748306.221532:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388563840:0@lo:101: 00000100:00100000:3.0:1788748306.221645:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.221742:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82dae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.221955:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563840 00000100:00100000:0.0:1788748306.221966:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563840 00000100:00100000:0.0:1788748306.222050:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788748306.222062:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388563840:12345-0@lo:101: 00010000:00010000:0.0:1788748306.222083:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748306.222105:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19e7d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.222137:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.222149:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.222159:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940600, rc 0) 00000100:00100000:0.0:1788748306.222212:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388563840:12345-0@lo:101: Request processed in 152us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.222219:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788748306.222297:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388563840:0@lo:101: 00010000:00010000:0.0:1788748306.222341:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.222352:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.223748:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388563968:0@lo:501: 00000100:00100000:0.0:1788748306.223827:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.223877:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748306.224064:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388563968 00000100:00100000:3.0:1788748306.224073:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388563968 00000100:00100000:3.0:1788748306.224134:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788748306.224144:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388563968:12345-0@lo:501: 00000100:00100000:3.0:1788748306.224345:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388563968:12345-0@lo:501: Request processed in 202us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.224354:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788748306.225022:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388563968:0@lo:501: 00000100:00100000:0.0:1788748306.225075:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564096:0@lo:503: 00000100:00100000:0.0:1788748306.225144:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.225192:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.228092:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748306.230279:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564096 00000100:00100000:3.0:1788748306.230298:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564096 00000100:00100000:3.0:1788748306.230378:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788748306.230390:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388564096:12345-0@lo:503: 00000100:00100000:3.0:1788748306.230607:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388564096:12345-0@lo:503: Request processed in 219us (5462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.230615:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788748306.233351:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388564224:0@lo:41: 00000100:00100000:0.0:1788748306.233444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.233528:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564096:0@lo:503: 00000100:00100000:2.0:1788748306.234033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564224 00000100:00100000:2.0:1788748306.234044:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564224 00000100:00100000:2.0:1788748306.234114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788748306.234124:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388564224:12345-0@lo:41: 00000004:00000024:2.0:1788748306.234169:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788748306.239774:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10002:1875638388564352:0@lo:502: 00000100:00100000:3.0:1788748306.239897:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.239973:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564352 00000100:00100000:0.0:1788748306.239981:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564352 00000100:00100000:0.0:1788748306.240033:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788748306.240043:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10002:x1875638388564352:12345-0@lo:502: 00000100:00100000:2.0:1788748306.241674:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388564224:12345-0@lo:41: Request processed in 7541us (8220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.241706:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748306.246335:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10002:x1875638388564352:12345-0@lo:502: Request processed in 6263us (6408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.246356:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788748306.246630:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388564224:0@lo:41: 00000100:00100000:3.0:1788748306.248799:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748306.248855:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10002:1875638388564352:0@lo:502: 00000100:00100000:3.0:1788748306.248980:0:10002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10002:1875638388564480:0@lo:502: 00000100:00100000:3.0:1788748306.249071:0:10002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.249120:0:10002:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.249457:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564480 00000100:00100000:2.0:1788748306.249468:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564480 00000100:00100000:2.0:1788748306.249539:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788748306.249550:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10002:x1875638388564480:12345-0@lo:502: 00000100:00100000:2.0:1788748306.249722:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10002:x1875638388564480:12345-0@lo:502: Request processed in 173us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.249742:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788748306.251391:0:10002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10002:1875638388564480:0@lo:502: 00000040:00080000:3.0:1788748306.251462:0:10002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788748306.252080:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788748306.252114:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748306.252126:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.252140:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748306.252152:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788748306.252155:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788748306.252158:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788748306.252202:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.252209:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.252221:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748306.252255:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564608:0@lo:101: 00000100:00100000:2.0:1788748306.252357:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.252409:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.252491:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564608 00000100:00100000:1.0:1788748306.252499:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564608 00000100:00100000:1.0:1788748306.252565:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788748306.252574:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388564608:12345-0@lo:101: 00010000:00010000:1.0:1788748306.252590:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748306.252605:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19e8b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.252642:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.252653:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.252663:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813fa400, rc 0) 00000100:00100000:1.0:1788748306.252706:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388564608:12345-0@lo:101: Request processed in 134us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.252713:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788748306.252766:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564608:0@lo:101: 00010000:00010000:1.0:1788748306.252780:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.252789:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748306.252851:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564736:0@lo:501: 00000100:00100000:1.0:1788748306.252890:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.253031:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86600 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.253046:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564736 00000100:00100000:1.0:1788748306.253051:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564736 00000100:00100000:1.0:1788748306.253069:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788748306.253074:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388564736:12345-0@lo:501: 00000100:00100000:1.0:1788748306.253208:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388564736:12345-0@lo:501: Request processed in 133us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.253217:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788748306.253463:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564736:0@lo:501: 00000100:00100000:0.0:1788748306.253512:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564864:0@lo:503: 00000100:00100000:0.0:1788748306.254236:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.254429:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564864 00000100:00100000:0.0:1788748306.254431:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.254437:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564864 00000100:00100000:1.0:1788748306.254488:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788748306.254496:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388564864:12345-0@lo:503: 00000100:00100000:1.0:1788748306.254608:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388564864:12345-0@lo:503: Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.254616:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788748306.255036:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388564864:0@lo:503: 00000100:00100000:2.0:1788748306.257889:0:10003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10003:1875638388564992:0@lo:502: 00000100:00100000:2.0:1788748306.258121:0:10003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.258195:0:10003:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21480 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.258266:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388564992 00000100:00100000:1.0:1788748306.258277:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388564992 00000100:00100000:1.0:1788748306.258362:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788748306.258373:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10003:x1875638388564992:12345-0@lo:502: 00000100:00100000:1.0:1788748306.258529:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10003:x1875638388564992:12345-0@lo:502: Request processed in 157us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.258537:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788748306.258664:0:10003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10003:1875638388564992:0@lo:502: 00000020:01000000:3.0:1788748306.258702:0:10003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748306.258713:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748306.258716:0:10003:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788748306.258721:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788748306.258733:0:10003:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788748306.258757:0:10003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10003:1875638388565120:0@lo:502: 00000100:00100000:3.0:1788748306.258795:0:10003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.258824:0:10003:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.258990:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388565120 00000100:00100000:1.0:1788748306.258995:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388565120 00000100:00100000:1.0:1788748306.259029:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748306.259045:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10003:x1875638388565120:12345-0@lo:502: 00000100:00100000:1.0:1788748306.259116:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10003:x1875638388565120:12345-0@lo:502: Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.259123:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788748306.259766:0:10003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10003:1875638388565120:0@lo:502: 00000020:01000000:3.0:1788748306.259798:0:10003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748306.259805:0:10003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748306.259807:0:10003:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788748306.259810:0:10003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788748306.259991:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788748306.260018:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788748306.260031:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.260044:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748306.260054:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788748306.260058:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8add8f106000 from 39 10000000:01000000:1.0:1788748306.260061:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788748306.260097:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.260106:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.260115:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748306.260133:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565248:0@lo:101: 00000100:00100000:1.0:1788748306.260178:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.260212:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.260272:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388565248 00000100:00100000:2.0:1788748306.260279:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388565248 00000100:00100000:2.0:1788748306.260345:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788748306.260355:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388565248:12345-0@lo:101: 00010000:00010000:2.0:1788748306.260367:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748306.260381:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19e99 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.260409:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.260420:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.260430:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6200, rc 0) 00000100:00100000:2.0:1788748306.260468:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388565248:12345-0@lo:101: Request processed in 115us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.260474:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788748306.260563:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565248:0@lo:101: 00010000:00010000:1.0:1788748306.260578:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.260596:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748306.260669:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565376:0@lo:501: 00000100:00100000:1.0:1788748306.260698:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.260731:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.261035:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388565376 00000100:00100000:2.0:1788748306.261041:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388565376 00000100:00100000:2.0:1788748306.261077:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788748306.261096:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388565376:12345-0@lo:501: 00000100:00100000:2.0:1788748306.261246:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388565376:12345-0@lo:501: Request processed in 153us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.261253:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788748306.261342:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565376:0@lo:501: 00000100:00100000:3.0:1788748306.261379:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565504:0@lo:503: 00000100:00100000:3.0:1788748306.261421:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.261441:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.261488:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388565504 00000100:00100000:2.0:1788748306.261491:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388565504 00000100:00100000:2.0:1788748306.261517:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788748306.261524:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388565504:12345-0@lo:503: 00000100:00100000:2.0:1788748306.261603:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388565504:12345-0@lo:503: Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.261609:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788748306.262052:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565504:0@lo:503: 00000100:00100000:3.0:1788748306.263059:0:10004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10004:1875638388565632:0@lo:502: 00000100:00100000:3.0:1788748306.263139:0:10004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.263194:0:10004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.263700:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388565632 00000100:00100000:2.0:1788748306.263710:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388565632 00000100:00100000:2.0:1788748306.263770:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788748306.263781:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10004:x1875638388565632:12345-0@lo:502: 00000100:00100000:2.0:1788748306.265063:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10004:x1875638388565632:12345-0@lo:502: Request processed in 1276us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.265077:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788748306.265244:0:10004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10004:1875638388565632:0@lo:502: 00000100:00100000:3.0:1788748306.265369:0:10004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10004:1875638388565760:0@lo:502: 00000100:00100000:3.0:1788748306.265422:0:10004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.265466:0:10004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.265519:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388565760 00000100:00100000:1.0:1788748306.265528:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388565760 00000100:00100000:1.0:1788748306.265576:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788748306.265585:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10004:x1875638388565760:12345-0@lo:502: 00000100:00100000:1.0:1788748306.265736:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10004:x1875638388565760:12345-0@lo:502: Request processed in 151us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.265743:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788748306.266020:0:10004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10004:1875638388565760:0@lo:502: 00000040:00080000:2.0:1788748306.266046:0:10004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788748306.266377:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788748306.266406:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748306.266419:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.266432:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748306.266443:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788748306.266445:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add8f106000 from 6 10000000:01000000:1.0:1788748306.266449:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788748306.266501:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.266509:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.266527:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748306.266543:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565888:0@lo:101: 00000100:00100000:1.0:1788748306.266586:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.266618:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.266847:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388565888 00000100:00100000:2.0:1788748306.266854:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388565888 00000100:00100000:2.0:1788748306.266895:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788748306.268018:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388565888:12345-0@lo:101: 00010000:00010000:2.0:1788748306.268045:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748306.268074:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19eae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19ea7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.268124:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ea7 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.268135:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ea7 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.268147:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f7200, rc 0) 00000100:00100000:2.0:1788748306.268234:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388565888:12345-0@lo:101: Request processed in 1331us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.268243:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788748306.268499:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388565888:0@lo:101: 00010000:00010000:3.0:1788748306.268518:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748306.268529:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748306.268603:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566016:0@lo:256: 00000100:00100000:3.0:1788748306.268648:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.268696:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.268751:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566016 00000100:00100000:2.0:1788748306.268758:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566016 00000100:00100000:2.0:1788748306.268804:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788748306.268812:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388566016:12345-0@lo:256: 20000000:01000000:2.0:1788748306.268829:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788748306.268849:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788748306.268852:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788748306.269185:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388566016:12345-0@lo:256: Request processed in 372us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.269193:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788748306.272196:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566016:0@lo:256: 10000000:01000000:2.0:1788748306.272439:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788748306.272453:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.272467:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748306.272478:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788748306.272492:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788748306.272495:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788748306.272540:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.272548:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.272559:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748306.272578:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566144:0@lo:101: 00000100:00100000:2.0:1788748306.272642:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.272689:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b219c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.273019:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566144 00000100:00100000:1.0:1788748306.273028:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566144 00000100:00100000:1.0:1788748306.273095:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788748306.273106:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388566144:12345-0@lo:101: 00010000:00010000:1.0:1788748306.273125:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748306.273140:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19eb5 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.273169:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 20 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.273180:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 20 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.273191:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb800, rc 0) 00000100:00100000:1.0:1788748306.273255:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388566144:12345-0@lo:101: Request processed in 151us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.273263:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788748306.273451:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566144:0@lo:101: 00010000:00010000:0.0:1788748306.273467:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.273478:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.273549:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566272:0@lo:501: 00000100:00100000:0.0:1788748306.273583:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.273618:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.273659:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566272 00000100:00100000:2.0:1788748306.273664:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566272 00000100:00100000:2.0:1788748306.273698:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788748306.273705:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388566272:12345-0@lo:501: 00000100:00100000:2.0:1788748306.273865:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388566272:12345-0@lo:501: Request processed in 160us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.273873:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788748306.274022:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566272:0@lo:501: 00000100:00100000:0.0:1788748306.274055:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566400:0@lo:503: 00000100:00100000:0.0:1788748306.274102:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.274125:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.274168:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566400 00000100:00100000:2.0:1788748306.274173:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566400 00000100:00100000:2.0:1788748306.274209:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788748306.274215:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388566400:12345-0@lo:503: 00000100:00100000:2.0:1788748306.274342:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388566400:12345-0@lo:503: Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.274349:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788748306.274430:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388566400:0@lo:503: 00000100:00100000:1.0:1788748306.274818:0:10005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10005:1875638388566528:0@lo:502: 00000100:00100000:1.0:1788748306.274867:0:10005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.274896:0:10005:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.274994:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566528 00000100:00100000:2.0:1788748306.275006:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566528 00000100:00100000:2.0:1788748306.275044:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788748306.275051:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10005:x1875638388566528:12345-0@lo:502: 00000100:00100000:2.0:1788748306.277045:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10005:x1875638388566528:12345-0@lo:502: Request processed in 1983us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.277062:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788748306.277444:0:10005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10005:1875638388566528:0@lo:502: 00000020:01000000:1.0:1788748306.277495:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748306.277507:0:10005:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788748306.277515:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748306.277517:0:10005:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788748306.277523:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788748306.277527:0:10005:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:1.0:1788748306.277559:0:10005:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788748306.277563:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748306.277585:0:10005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8adc83b14d40) 00000020:00000080:1.0:1788748306.277617:0:10005:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788748306.277625:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788748306.277761:0:10005:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788748306.277770:0:10005:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788748306.277778:0:10005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e19eca 00010000:00080000:1.0:1788748306.277823:0:10005:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8addae41e000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748306.279231:0:10005:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788748306.280128:0:10005:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788748306.280148:0:10005:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788748306.281103:0:10005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748306.281266:0:10005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748306.281584:0:10005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788748306.281683:0:10005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788748306.290699:0:10006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748306.290709:0:10006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788748306.291706:0:10005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788748306.291735:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788748306.291786:0:10005:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788748306.291821:0:10005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e19ed1 00000100:00080000:2.0:1788748306.291833:0:10005:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748306.291847:0:10005:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8addae41e000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748306.291895:0:10005:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8addb3928000 x1875638388566656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748306.292487:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388566656:0@lo:8: 00000100:00100000:3.0:1788748306.292598:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.292719:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566656 00000100:00100000:1.0:1788748306.292739:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566656 00000100:00100000:1.0:1788748306.292785:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748306.292801:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875638388566656:12345-0@lo:8: 00010000:00080000:1.0:1788748306.292838:0:8424:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1788748306.292877:0:8424:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e19ed8 00002000:00100000:1.0:1788748306.292894:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8addbf54d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788748306.292899:0:8424:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788748306.292914:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788748306.292998:0:8424:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788748306.293353:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788748306.293386:0:8424:0:(import.c:65:import_set_state_nolock()) ffff8addbf54d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748306.294308:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875638388566656:12345-0@lo:8: Request processed in 1502us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.294351:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788748306.294384:0:10005:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788748306.294506:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748306.294514:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748306.294516:0:10005:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788748306.294520:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748306.294526:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748306.294527:0:10005:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748306.294531:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748306.294533:0:10005:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788748306.294579:0:10005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10005:1875638388566784:0@lo:502: 00000100:00100000:1.0:1788748306.294652:0:10005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.294697:0:10005:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.294732:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566784 00000100:00100000:0.0:1788748306.294743:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566784 00000100:00100000:0.0:1788748306.294803:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788748306.294814:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10005:x1875638388566784:12345-0@lo:502: 00000100:00100000:0.0:1788748306.294967:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10005:x1875638388566784:12345-0@lo:502: Request processed in 155us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.294975:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788748306.295116:0:10005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10005:1875638388566784:0@lo:502: 00000020:01000000:1.0:1788748306.295147:0:10005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748306.295151:0:10005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748306.295153:0:10005:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788748306.295163:0:10005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1788748306.295502:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388566912:0@lo:400: 00000100:00100000:1.0:1788748306.297001:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388567040:0@lo:400: 00000100:00100000:1.0:1788748306.297083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.297133:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388567552:0@lo:400: 00000100:00100000:1.0:1788748306.297165:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.297197:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788748306.297204:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388567168:0@lo:400: 00000100:00100000:1.0:1788748306.297261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.297282:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388567680:0@lo:400: 00000100:00100000:1.0:1788748306.297312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.297380:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567040 00000100:00100000:1.0:1788748306.297389:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567040 00000020:01000000:0.0:1788748306.297424:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00000100:00100000:1.0:1788748306.297464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 10000000:01000000:0.0:1788748306.297467:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:1.0:1788748306.297476:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388567040:12345-0@lo:400: 00010000:00010000:0.0:1788748306.297496:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.297510:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748306.297524:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788748306.297528:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adda7357000 from 39 10000000:01000000:0.0:1788748306.297532:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:1.0:1788748306.297543:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388567040:12345-0@lo:400: Request processed in 69us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.297551:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788748306.297570:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748306.297578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567168 00010000:00010000:0.0:1788748306.297581:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748306.297583:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567168 00010000:00010000:0.0:1788748306.297598:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.297618:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568064:0@lo:101: 00000100:00100000:0.0:1788748306.297655:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.297718:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.297731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748306.297744:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388567168:12345-0@lo:400: 00000100:00100000:1.0:1788748306.297777:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388567168:12345-0@lo:400: Request processed in 37us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.297784:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788748306.297829:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdea00 x1875638388567168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748306.297844:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388567168:0@lo:400: 00000100:00100000:1.0:1788748306.297865:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388567040:0@lo:400: 00000100:00100000:2.0:1788748306.298362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.298442:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388567424:0@lo:400: 00000100:00100000:0.0:1788748306.298492:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388566912 00000100:00100000:0.0:1788748306.298500:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388566912 00000100:00100000:2.0:1788748306.298515:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.298545:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388567936:0@lo:400: 00000100:00100000:0.0:1788748306.298552:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567424 00000100:00100000:0.0:1788748306.298558:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567424 00000100:00100000:2.0:1788748306.298579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.298600:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567936 00000100:00100000:1.0:1788748306.298607:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567936 00000100:00100000:0.0:1788748306.298614:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748306.298625:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388566912:12345-0@lo:400: 00000100:00100000:2.0:1788748306.298641:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788748306.298652:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388567296:0@lo:400: 00000100:00100000:2.0:1788748306.299092:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.299110:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388567808:0@lo:400: 00000100:00100000:0.0:1788748306.299131:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388566912:12345-0@lo:400: Request processed in 504us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.299144:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.299148:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748306.299183:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567296 00010000:00080000:2.0:1788748306.299186:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fddf80 x1875638388566912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748306.299190:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567296 00000100:00100000:0.0:1788748306.299209:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567808 00000100:00100000:0.0:1788748306.299214:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567808 00000100:00100000:2.0:1788748306.299221:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388566912:0@lo:400: 00000100:00100000:0.0:1788748306.299241:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788748306.299254:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388567424:12345-0@lo:400: 00000100:00100000:0.0:1788748306.299300:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388567424:12345-0@lo:400: Request processed in 51us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.299306:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788748306.299346:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748306.299353:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388567936:12345-0@lo:400: 00000100:00100000:0.0:1788748306.299383:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388567936:12345-0@lo:400: Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.299389:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748306.299404:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788748306.299410:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388567296:12345-0@lo:400: 00000100:00100000:0.0:1788748306.299437:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388567296:12345-0@lo:400: Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.299443:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788748306.299454:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788748306.299459:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388567808:12345-0@lo:400: 00000100:00100000:0.0:1788748306.299487:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388567808:12345-0@lo:400: Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.299493:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748306.299613:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567552 00000100:00100000:2.0:1788748306.299689:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567552 00000100:00100000:0.0:1788748306.300975:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388567680 00000100:00100000:0.0:1788748306.300986:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388567680 00000100:00100000:0.0:1788748306.301052:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748306.301078:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388567552:12345-0@lo:400: 00000100:00100000:0.0:1788748306.301180:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388567552:12345-0@lo:400: Request processed in 105us (4013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.301188:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748306.301208:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748306.301214:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388567680:12345-0@lo:400: 00000100:00100000:0.0:1788748306.301242:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388567680:12345-0@lo:400: Request processed in 29us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.301248:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788748306.301647:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3928000 x1875638388566656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748306.301664:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748306.301677:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788748306.301687:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788748306.301696:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788748306.301700:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addae41e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788748306.301739:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788748306.301748:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388566656:0@lo:8: 00000100:00080000:2.0:1788748306.302171:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748306.302177:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748306.302180:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788748306.302217:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdd180 x1875638388567296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.302244:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388567296:0@lo:400: 00000100:00100000:0.0:1788748306.302711:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388568192:0@lo:700: 00000100:00100000:0.0:1788748306.302806:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.302903:0:8735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568192 00000100:00100000:0.0:1788748306.302909:0:8735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568192 00000100:00100000:0.0:1788748306.302965:0:8735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748306.302973:0:8735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10007:x1875638388568192:12345-0@lo:700: 00000100:00100000:0.0:1788748306.303010:0:8735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8735:1875638388568320:0@lo:700: 00000100:00100000:0.0:1788748306.303038:0:8735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748306.303054:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748306.303066:0:8735:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.303087:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748306.303417:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568064 00010000:00080000:2.0:1788748306.303450:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533d500 x1875638388567808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.303475:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388567808:0@lo:400: 00000100:00100000:3.0:1788748306.303495:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568064 00010000:00080000:2.0:1788748306.303497:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdca80 x1875638388567424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.303512:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388567424:0@lo:400: 00010000:00080000:2.0:1788748306.303529:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ed80 x1875638388567936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.303537:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388567936:0@lo:400: 00000100:00100000:3.0:1788748306.303558:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788748306.303570:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388568064:12345-0@lo:101: 00010000:00010000:3.0:1788748306.303588:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748306.303614:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19edf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748306.303648:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748306.303663:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748306.303674:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76200, rc 0) 00000100:00100000:3.0:1788748306.303768:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388568064:12345-0@lo:101: Request processed in 201us (6111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.303798:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:1.0:1788748306.304055:0:10006:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788748306.304132:0:10006:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 223290814974ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788748306.304140:0:10006:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788748306.304169:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568320 00000100:00100000:1.0:1788748306.304175:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568320 00000100:00100000:1.0:1788748306.304209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748306.304216:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8735:x1875638388568320:12345-0@lo:700: 00010000:00080000:1.0:1788748306.304419:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533f480 x1875638388567680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748306.304431:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388567680:0@lo:400: 00010000:00080000:1.0:1788748306.304443:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ce00 x1875638388567552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748306.304452:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388567552:0@lo:400: 00000100:00100000:0.0:1788748306.304824:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568064:0@lo:101: 00010000:00010000:0.0:1788748306.304898:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.304911:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.304990:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568448:0@lo:501: 00000100:00100000:0.0:1788748306.305056:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.305104:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.305550:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568448 00000100:00100000:1.0:1788748306.305557:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568448 00000100:00100000:1.0:1788748306.305601:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788748306.305611:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388568448:12345-0@lo:501: 00000100:00100000:1.0:1788748306.305763:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388568448:12345-0@lo:501: Request processed in 153us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.305771:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788748306.306465:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568448:0@lo:501: 00000100:00100000:0.0:1788748306.306503:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568576:0@lo:503: 00000100:00100000:0.0:1788748306.306553:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.306585:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.306809:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568576 00000100:00100000:2.0:1788748306.306816:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568576 00000100:00100000:2.0:1788748306.306851:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788748306.306860:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388568576:12345-0@lo:503: 00000100:00100000:2.0:1788748306.306952:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388568576:12345-0@lo:503: Request processed in 93us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.306968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788748306.307010:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568576:0@lo:503: 00000004:00080000:0.0:1788748306.308950:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788748306.309279:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10009:1875638388568704:0@lo:502: 00000100:00100000:3.0:1788748306.309405:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.309475:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.310060:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568704 00000100:00100000:0.0:1788748306.310071:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568704 00000100:00100000:0.0:1788748306.310134:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788748306.310146:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10009:x1875638388568704:12345-0@lo:502: 00000100:00100000:0.0:1788748306.310401:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10009:x1875638388568704:12345-0@lo:502: Request processed in 257us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.310409:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788748306.311960:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10009:1875638388568704:0@lo:502: 00000100:00100000:2.0:1788748306.312046:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10009:1875638388568832:0@lo:502: 00000100:00100000:2.0:1788748306.312127:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.312180:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748306.312512:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568832 00000100:00100000:3.0:1788748306.312525:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568832 00000100:00100000:3.0:1788748306.312581:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788748306.312593:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10009:x1875638388568832:12345-0@lo:502: 00000100:00100000:3.0:1788748306.312787:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10009:x1875638388568832:12345-0@lo:502: Request processed in 194us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.312796:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788748306.313247:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10009:1875638388568832:0@lo:502: 00000040:00080000:2.0:1788748306.313344:0:10009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788748306.313474:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788748306.313520:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748306.313534:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.313550:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748306.313562:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748306.313566:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adda7357000 from 6 10000000:01000000:0.0:1788748306.313570:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748306.313609:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.313632:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.313642:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.313665:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568960:0@lo:101: 00000100:00100000:0.0:1788748306.313715:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.313774:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748306.314475:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388568960 00000100:00100000:2.0:1788748306.314486:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388568960 00000100:00100000:2.0:1788748306.314535:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788748306.314546:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388568960:12345-0@lo:101: 00010000:00010000:2.0:1788748306.314561:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748306.314580:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f7a00/0x9ba0f20a02e19ef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19eed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.314609:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f7a00/0x9ba0f20a02e19ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19eed expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.314620:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f7a00/0x9ba0f20a02e19ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19eed expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748306.314629:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f7a00, rc 0) 00000100:00100000:2.0:1788748306.314815:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388568960:12345-0@lo:101: Request processed in 270us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.314823:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 40000000:02000000:2.0:1788748306.314914:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788748306.315369:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388568960:0@lo:101: 00010000:00010000:0.0:1788748306.315395:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.315408:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.315495:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569088:0@lo:256: 00000100:00100000:0.0:1788748306.315564:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.315616:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.315644:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569088 00000100:00100000:0.0:1788748306.315651:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569088 00000100:00100000:0.0:1788748306.315699:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788748306.315708:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388569088:12345-0@lo:256: 20000000:01000000:0.0:1788748306.315740:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788748306.315764:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788748306.315767:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788748306.315875:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388569088:12345-0@lo:256: Request processed in 168us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.315891:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788748306.317835:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569088:0@lo:256: 10000000:01000000:0.0:1788748306.318039:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748306.318053:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.318068:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748306.318080:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788748306.318084:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788748306.318088:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788748306.318133:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.318141:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.318151:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.319157:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569216:0@lo:101: 00000100:00100000:0.0:1788748306.319336:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.319404:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.321984:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569216 00000100:00100000:1.0:1788748306.322000:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569216 00000100:00100000:1.0:1788748306.322071:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788748306.322101:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388569216:12345-0@lo:101: 00010000:00010000:1.0:1788748306.322121:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748306.322142:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19efb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.322173:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.322185:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.322195:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbbe00, rc 0) 00000100:00100000:1.0:1788748306.322274:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388569216:12345-0@lo:101: Request processed in 177us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.322281:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788748306.323119:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569216:0@lo:101: 00010000:00010000:0.0:1788748306.323154:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.325535:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.325665:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569344:0@lo:501: 00000100:00100000:0.0:1788748306.325765:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.325836:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.325858:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569344 00000100:00100000:1.0:1788748306.325874:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569344 00000100:00100000:1.0:1788748306.325937:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788748306.325948:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388569344:12345-0@lo:501: 00000100:00100000:1.0:1788748306.326115:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388569344:12345-0@lo:501: Request processed in 169us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.326124:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788748306.326418:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569344:0@lo:501: 00000100:00100000:0.0:1788748306.326460:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569472:0@lo:503: 00000100:00100000:0.0:1788748306.326522:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.326559:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.326580:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569472 00000100:00100000:0.0:1788748306.326586:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569472 00000100:00100000:0.0:1788748306.326633:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788748306.326642:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388569472:12345-0@lo:503: 00000100:00100000:0.0:1788748306.328039:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388569472:12345-0@lo:503: Request processed in 1390us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.328055:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788748306.328144:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569472:0@lo:503: 00000100:00100000:3.0:1788748306.329375:0:10011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10011:1875638388569600:0@lo:502: 00000100:00100000:3.0:1788748306.329456:0:10011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.329535:0:10011:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.329901:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569600 00000100:00100000:0.0:1788748306.329920:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569600 00000100:00100000:0.0:1788748306.330055:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788748306.330066:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10011:x1875638388569600:12345-0@lo:502: 00000100:00100000:0.0:1788748306.332801:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10011:x1875638388569600:12345-0@lo:502: Request processed in 2724us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.332837:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788748306.333516:0:10011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10011:1875638388569600:0@lo:502: 00000020:01000000:3.0:1788748306.333569:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788748306.333579:0:10011:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788748306.333587:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748306.333589:0:10011:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788748306.333595:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788748306.333599:0:10011:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:3.0:1788748306.333630:0:10011:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788748306.333633:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748306.333669:0:10011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8adc840f8000) 00000020:00000080:3.0:1788748306.333704:0:10011:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788748306.333713:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788748306.333853:0:10011:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788748306.333868:0:10011:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788748306.333877:0:10011:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e19f10 00010000:00080000:3.0:1788748306.333924:0:10011:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc83d2e000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788748306.334386:0:10011:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788748306.334608:0:10011:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788748306.334628:0:10011:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788748306.334862:0:10011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748306.337513:0:10011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748306.337751:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788748306.337901:0:10011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1788748306.342890:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8735:x1875638388568320:12345-0@lo:700: Request processed in 38658us (39835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.342916:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788748306.343012:0:8735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bd180 x1875638388568320/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748306.343692:0:8735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8735:1875638388568320:0@lo:700: 40000000:02000000:3.0:1788748306.343710:0:8735:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1788748306.350009:0:10014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748306.350018:0:10014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788748306.362539:0:10011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788748306.362556:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788748306.362608:0:10011:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788748306.362635:0:10011:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e19f17 00000100:00080000:0.0:1788748306.362647:0:10011:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748306.362661:0:10011:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8adc83d2e000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748306.362699:0:10011:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc840bc700 x1875638388569728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748306.362735:0:10011:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788748306.362805:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748306.362810:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748306.362812:0:10011:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788748306.362816:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748306.362820:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748306.362821:0:10011:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748306.362824:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748306.362826:0:10011:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788748306.362855:0:10011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10011:1875638388569856:0@lo:502: 00000100:00100000:0.0:1788748306.362996:0:10011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.363086:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569856 00000100:00100000:1.0:1788748306.363095:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569856 00000100:00100000:0.0:1788748306.363116:0:10011:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71ae300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.363144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788748306.363154:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10011:x1875638388569856:12345-0@lo:502: 00000100:00100000:1.0:1788748306.363345:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10011:x1875638388569856:12345-0@lo:502: Request processed in 164us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.363355:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788748306.363372:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388569728:0@lo:8: 00000100:00100000:3.0:1788748306.363458:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.363577:0:10011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10011:1875638388569856:0@lo:502: 00000100:00100000:3.0:1788748306.363600:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569728 00000100:00100000:3.0:1788748306.363609:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569728 00000100:00100000:3.0:1788748306.363649:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748306.363694:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875638388569728:12345-0@lo:8: 00000020:01000000:0.0:1788748306.363716:0:10011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748306.363733:0:10011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748306.363735:0:10011:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788748306.363741:0:10011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00080000:3.0:1788748306.363762:0:8425:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1788748306.363809:0:8425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e19f1e 00002000:00100000:3.0:1788748306.363827:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8adc83d2f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788748306.363833:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788748306.363844:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1788748306.363868:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788748306.363892:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788748306.363911:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.363923:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748306.363935:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788748306.363939:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8add9ea619c0 from 1 10000000:01000000:0.0:1788748306.363942:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00002000:00080000:3.0:1788748306.363953:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00010000:0.0:1788748306.363975:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.363984:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788748306.363987:0:8425:0:(import.c:65:import_set_state_nolock()) ffff8adc83d2b000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1788748306.364000:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.364028:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569984:0@lo:101: 00000100:00100000:3.0:1788748306.364054:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1875638388569728:12345-0@lo:8: Request processed in 395us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.364064:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748306.364081:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.364117:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6f7300 going to sleep for 11 seconds 00000001:00100000:3.0:1788748306.364151:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:3.0:1788748306.364222:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bc700 x1875638388569728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748306.364225:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388569984 00000100:00100000:1.0:1788748306.364239:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388569984 00000100:00100000:3.0:1788748306.364241:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748306.364254:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788748306.364264:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788748306.364271:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788748306.364274:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc83d2e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788748306.364285:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000004:00080000:3.0:1788748306.364298:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788748306.364298:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388569984:12345-0@lo:101: 00000100:00100000:3.0:1788748306.364307:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388569728:0@lo:8: 00010000:00010000:1.0:1788748306.364356:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748306.364371:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19f25 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.364396:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.364407:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748306.364415:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb000, rc 0) 00000100:00100000:1.0:1788748306.364454:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388569984:12345-0@lo:101: Request processed in 160us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.364460:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000004:00080000:1.0:1788748306.364503:0:10014:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788748306.364573:0:10014:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223351255422ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788748306.364581:0:10014:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788748306.364653:0:8735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10007:x1875638388568192:12345-0@lo:700: Request processed in 61679us (61845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.364663:0:8735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748306.364699:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388569984:0@lo:101: 00010000:00010000:0.0:1788748306.364712:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.364732:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748306.364803:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388570112:0@lo:501: 00000100:00100000:0.0:1788748306.364829:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.364867:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6f7300 going to sleep for 11 seconds 00010000:00080000:0.0:1788748306.364893:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bdc00 x1875638388568192/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748306.364905:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388568192:0@lo:700: 00000100:00100000:1.0:1788748306.364988:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388570112 00000100:00100000:1.0:1788748306.364994:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388570112 00000100:00100000:1.0:1788748306.365030:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788748306.365038:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388570112:12345-0@lo:501: 00000100:00100000:1.0:1788748306.365292:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388570112:12345-0@lo:501: Request processed in 253us (461us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788748306.365302:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788748306.365472:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388570112:0@lo:501: 10000000:01000000:0.0:1788748306.365500:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788748306.365507:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748306.365517:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748306.372567:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788748306.372735:0:10016:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788748306.372768:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388570368:0@lo:7: 00000100:00100000:2.0:1788748306.372836:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.372873:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388570368 00000100:00100000:2.0:1788748306.372880:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388570368 00000100:00100000:2.0:1788748306.373483:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748306.373492:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10016:x1875638388570368:12345-0@lo:7: 00000100:00080000:1.0:1788748306.373721:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748306.373832:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748306.373862:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388570240:0@lo:13: 00000100:00100000:3.0:1788748306.374006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.374101:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388570240 00000100:00100000:1.0:1788748306.374116:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388570240 00000100:00100000:1.0:1788748306.374165:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748306.374175:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388570240:12345-0@lo:13: 00002000:00000024:1.0:1788748306.374199:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:1.0:1788748306.374286:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388570240:12345-0@lo:13: Request processed in 113us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.374293:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788748306.374426:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb392ed80 x1875638388570240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748306.374448:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388570240:0@lo:13: 00002000:00080000:2.0:1788748306.387550:0:8734:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788748306.387560:0:8734:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788748306.387649:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10016:x1875638388570368:12345-0@lo:7: Request processed in 14153us (14807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748306.387658:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748306.387710:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add830d23c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788748306.387752:0:10016:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ce00 x1875638388570368/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.387766:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388570368:0@lo:7: 00000004:00080000:2.0:1788748306.387783:0:10016:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788748306.387828:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388570496:0@lo:5: 00000100:00100000:2.0:1788748306.387865:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.387908:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111600 going to sleep for 11 seconds 00000100:00100000:1.0:1788748306.387941:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388570496 00000100:00100000:1.0:1788748306.387949:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388570496 00000100:00100000:1.0:1788748306.387998:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748306.388009:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10016:x1875638388570496:12345-0@lo:5: 00002000:00080000:1.0:1788748306.388034:0:8425:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788748306.388039:0:8425:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:0.0:1788748306.394408:0:10007:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788748306.394451:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388570752:0@lo:7: 00000100:00100000:0.0:1788748306.394514:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748306.394558:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6f7300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.394578:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388570752 00000100:00100000:0.0:1788748306.394583:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388570752 00000100:00100000:0.0:1788748306.394640:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748306.394649:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10007:x1875638388570752:12345-0@lo:7: 00000100:00100000:0.0:1788748306.396292:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748306.396336:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388570624:0@lo:13: 00000100:00100000:0.0:1788748306.396394:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748306.396677:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388570624 00000100:00100000:1.0:1788748306.396684:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388570624 00000100:00100000:1.0:1788748306.396739:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748306.396749:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875638388570624:12345-0@lo:13: 00002000:00000024:1.0:1788748306.396771:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:1.0:1788748306.396824:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875638388570624:12345-0@lo:13: Request processed in 78us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.396832:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788748306.396862:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bed80 x1875638388570624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748306.396882:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388570624:0@lo:13: 00000001:00080000:3.0:1788748306.416169:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788748306.416189:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788748306.425236:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10016:x1875638388570496:12345-0@lo:5: Request processed in 37220us (37360us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788748306.425250:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788748306.425368:0:10016:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ce00 x1875638388570496/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.425387:0:10016:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788748306.425395:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388570496:0@lo:5: 00000004:00080000:2.0:1788748306.425417:0:10016:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788748306.425516:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388570880:0@lo:700: 00000100:00100000:2.0:1788748306.425579:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.425624:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748306.425650:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388570880 00000100:00100000:3.0:1788748306.425661:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388570880 00000100:00100000:3.0:1788748306.425714:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748306.425742:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10016:x1875638388570880:12345-0@lo:700: 00000100:00100000:0.0:1788748306.432542:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10016:x1875638388570880:12345-0@lo:700: Request processed in 6811us (6953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.432556:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788748306.432616:0:10016:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ce00 x1875638388570880/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748306.432631:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388570880:0@lo:700: 00002000:00080000:1.0:1788748306.442339:0:8424:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788748306.442353:0:8424:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788748306.442492:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10007:x1875638388570752:12345-0@lo:7: Request processed in 47838us (47971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748306.442506:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788748306.442844:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bdc00 x1875638388570752/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.442862:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388570752:0@lo:7: 00000004:00080000:2.0:1788748306.442883:0:10007:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788748306.442936:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388571008:0@lo:5: 00000100:00100000:2.0:1788748306.442999:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.443054:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb51110c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748306.444065:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571008 00000100:00100000:3.0:1788748306.444082:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571008 00000100:00100000:3.0:1788748306.444168:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748306.444179:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10007:x1875638388571008:12345-0@lo:5: 00002000:00080000:3.0:1788748306.444214:0:8427:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788748306.444384:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10007:x1875638388571008:12345-0@lo:5: Request processed in 207us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748306.444394:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788748306.444457:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ce00 x1875638388571008/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748306.444474:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388571008:0@lo:5: 00000004:00080000:3.0:1788748306.444493:0:10007:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788748306.444544:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388571136:0@lo:5: 00000100:00100000:3.0:1788748306.444579:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748306.444603:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748306.444616:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571136 00000100:00100000:3.0:1788748306.444619:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571136 00000100:00100000:3.0:1788748306.444654:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748306.444663:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10007:x1875638388571136:12345-0@lo:5: 00002000:00080000:3.0:1788748306.444689:0:8425:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:02000040:0.0:1788748306.447177:0:10016:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788748306.453013:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:10007:x1875638388571136:12345-0@lo:5: Request processed in 8344us (8428us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788748306.453026:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788748306.453909:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc839500 x1875638388571136/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748306.453944:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10007:1875638388571136:0@lo:5: 00000004:00080000:2.0:1788748306.453965:0:10007:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788748306.454030:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10007:1875638388571264:0@lo:900: 00000100:00100000:2.0:1788748306.454102:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.454145:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.456200:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571264 00000100:00100000:0.0:1788748306.456214:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571264 00000100:00100000:0.0:1788748306.456428:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748306.456440:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10007:x1875638388571264:12345-0@lo:900: 00000100:00100000:0.0:1788748306.456538:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10007:x1875638388571264:12345-0@lo:900: Request processed in 101us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748306.456546:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788748306.457269:0:10007:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3a8a680 x1875638388571264/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748306.457300:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10007:1875638388571264:0@lo:900: 00000100:00100000:2.0:1788748306.457357:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a88700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388571392:0@lo:5: 00000100:00100000:2.0:1788748306.457433:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748306.457478:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb51110c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748306.457520:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571392 00000100:00100000:0.0:1788748306.457527:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571392 00000100:00100000:0.0:1788748306.457575:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748306.457584:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10016:x1875638388571392:12345-0@lo:5: 00002000:00080000:2.0:1788748306.462600:0:8734:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788748306.462629:0:8734:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788748306.472862:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10016:x1875638388571392:12345-0@lo:5: Request processed in 15267us (15417us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788748306.472879:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788748306.475126:0:10016:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3a88700 x1875638388571392/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748306.475177:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a88700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10016:1875638388571392:0@lo:5: 00000004:00080000:3.0:1788748306.475201:0:10016:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:3.0:1788748306.548248:0:10031:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788748306.548600:0:10031:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788748306.731439:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748307.240441:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388571520:0@lo:13: 00000100:00100000:2.0:1788748307.240534:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388571648:0@lo:13: 00000100:00100000:0.0:1788748307.240535:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748307.240875:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748307.240994:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571520 00000100:00100000:2.0:1788748307.241004:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571520 00000100:00100000:2.0:1788748307.241065:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571648 00000100:00100000:2.0:1788748307.241068:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571648 00000100:00100000:2.0:1788748307.241088:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748307.241099:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388571520:12345-0@lo:13: 00002000:00000024:2.0:1788748307.241139:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748307.241214:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388571520:12345-0@lo:13: Request processed in 117us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748307.241222:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748307.241242:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748307.241249:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388571648:12345-0@lo:13: 00002000:00000024:2.0:1788748307.241261:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748307.241302:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388571648:12345-0@lo:13: Request processed in 54us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748307.241309:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788748307.241482:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b0aa00 x1875638388571520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748307.241508:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388571520:0@lo:13: 00010000:00080000:1.0:1788748307.241701:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bed80 x1875638388571648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748307.241715:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388571648:0@lo:13: 00000020:00000004:2.0:1788748307.566676:0:10079:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748307.566688:0:10079:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788748307.749726:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748308.774246:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748308.983085:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748308.983370:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368600448 00000100:00100000:2.0:1788748308.983385:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368600448 00000100:00100000:2.0:1788748308.983449:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:2.0:1788748308.983460:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2409:x1875638368600448:12345-192.168.203.22@tcp:250: 00010000:00080000:2.0:1788748308.983503:0:6504:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 09ef6cf0-4626-4079-99a4-603102db0d3e@192.168.203.22@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:2.0:1788748308.983547:0:6504:0:(genops.c:1384:class_connect()) connect: client 09ef6cf0-4626-4079-99a4-603102db0d3e, cookie 0x9ba0f20a02e19f33 00000100:00080000:2.0:1788748308.983814:0:6504:0:(import.c:65:import_set_state_nolock()) ffff8addb53b6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748308.983984:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+5:2409:x1875638368600448:12345-192.168.203.22@tcp:250: Request processed in 523us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748308.983993:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:2.0:1788748308.996830:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748308.997539:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368600320 00000100:00100000:1.0:1788748308.997554:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368600320 00000100:00100000:1.0:1788748308.997634:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:1.0:1788748308.997645:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+5:6169:x1875638368600320:12345-192.168.203.22@tcp:101: 00010000:00010000:1.0:1788748308.997667:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748308.997691:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3a41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748308.997804:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748308.997819:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748308.997831:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb600, rc 0) 00000100:00100000:1.0:1788748308.997908:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+6:6169:x1875638368600320:12345-192.168.203.22@tcp:101: Request processed in 265us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748308.997916:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:1.0:1788748309.000523:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748309.002544:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368600576 00000100:00100000:2.0:1788748309.002563:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368600576 00000100:00100000:2.0:1788748309.002701:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1788748309.002729:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+6:6169:x1875638368600576:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1788748309.002903:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+6:6169:x1875638368600576:12345-192.168.203.22@tcp:501: Request processed in 177us (2392us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748309.002912:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:0.0:1788748309.013396:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748309.013658:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368600704 00000100:00100000:1.0:1788748309.013672:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368600704 00000100:00100000:1.0:1788748309.013755:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:1.0:1788748309.013785:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+6:6169:x1875638368600704:12345-192.168.203.22@tcp:101: 00010000:00010000:1.0:1788748309.013812:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748309.013836:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3a48 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.013873:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.013887:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.013897:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbac00, rc 0) 00000100:00100000:1.0:1788748309.013992:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+7:6169:x1875638368600704:12345-192.168.203.22@tcp:101: Request processed in 208us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748309.014000:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:3.0:1788748309.021931:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748309.022146:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368600832 00000100:00100000:2.0:1788748309.022160:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368600832 00000100:00100000:2.0:1788748309.022233:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:2.0:1788748309.022245:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+7:6169:x1875638368600832:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1788748309.022942:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6169:x1875638368600832:12345-192.168.203.22@tcp:501: Request processed in 693us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748309.022954:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:2.0:1788748309.035723:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748309.035986:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368600960 00000100:00100000:0.0:1788748309.036000:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368600960 00000100:00100000:0.0:1788748309.036142:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:0.0:1788748309.036155:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6169:x1875638368600960:12345-192.168.203.22@tcp:503: 00000100:00100000:0.0:1788748309.036483:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6169:x1875638368600960:12345-192.168.203.22@tcp:503: Request processed in 330us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748309.036493:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:0.0:1788748309.040850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748309.040981:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601088 00000100:00100000:2.0:1788748309.040995:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601088 00000100:00100000:2.0:1788748309.041069:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:2.0:1788748309.041082:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6188:x1875638368601088:12345-192.168.203.22@tcp:502: 00000100:00100000:2.0:1788748309.041364:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6188:x1875638368601088:12345-192.168.203.22@tcp:502: Request processed in 284us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748309.041374:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:3.0:1788748309.075226:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748309.075371:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601216 00000100:00100000:0.0:1788748309.075385:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601216 00000100:00100000:0.0:1788748309.075457:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:0.0:1788748309.075469:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6188:x1875638368601216:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1788748309.075746:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6188:x1875638368601216:12345-192.168.203.22@tcp:502: Request processed in 277us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748309.075755:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:3.0:1788748309.084537:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748309.085092:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601344 00000100:00100000:1.0:1788748309.085106:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601344 00000100:00100000:1.0:1788748309.085248:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:1.0:1788748309.085261:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6169:x1875638368601344:12345-192.168.203.22@tcp:101: 00010000:00010000:1.0:1788748309.085288:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748309.085312:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bba000/0x9ba0f20a02e19f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3a79 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.085457:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bba000/0x9ba0f20a02e19f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a79 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.085472:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bba000/0x9ba0f20a02e19f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a79 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.085507:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bba000, rc 0) 00000100:00100000:1.0:1788748309.085745:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6169:x1875638368601344:12345-192.168.203.22@tcp:101: Request processed in 485us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748309.085752:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:1.0:1788748309.088809:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748309.088960:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601472 00000100:00100000:2.0:1788748309.088973:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601472 00000100:00100000:2.0:1788748309.089109:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:2.0:1788748309.089122:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6169:x1875638368601472:12345-192.168.203.22@tcp:256: 20000000:01000000:2.0:1788748309.089155:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788748309.089186:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788748309.089191:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788748309.089194:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788748309.089197:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788748309.089199:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788748309.090588:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6169:x1875638368601472:12345-192.168.203.22@tcp:256: Request processed in 1459us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748309.090602:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:3.0:1788748309.093732:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748309.093881:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601600 00000100:00100000:1.0:1788748309.093896:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601600 00000100:00100000:1.0:1788748309.094037:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:1.0:1788748309.094050:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6169:x1875638368601600:12345-192.168.203.22@tcp:101: 00010000:00010000:1.0:1788748309.094074:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748309.094100:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3a80 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.094724:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.094740:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748309.094752:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb200, rc 0) 00000100:00100000:1.0:1788748309.094834:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6169:x1875638368601600:12345-192.168.203.22@tcp:101: Request processed in 787us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748309.094842:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:3.0:1788748309.097004:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748309.097128:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601728 00000100:00100000:2.0:1788748309.097142:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601728 00000100:00100000:2.0:1788748309.097200:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:2.0:1788748309.097211:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6169:x1875638368601728:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1788748309.097609:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6169:x1875638368601728:12345-192.168.203.22@tcp:501: Request processed in 397us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748309.097618:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:3.0:1788748309.099925:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748309.100040:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601856 00000100:00100000:1.0:1788748309.100053:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601856 00000100:00100000:1.0:1788748309.100125:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:1.0:1788748309.100138:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6169:x1875638368601856:12345-192.168.203.22@tcp:503: 00000100:00100000:1.0:1788748309.104683:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6169:x1875638368601856:12345-192.168.203.22@tcp:503: Request processed in 4355us (4577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748309.104702:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:0.0:1788748309.109516:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748309.109657:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368601984 00000100:00100000:2.0:1788748309.109671:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368601984 00000100:00100000:2.0:1788748309.109746:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:2.0:1788748309.109757:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6194:x1875638368601984:12345-192.168.203.22@tcp:502: 00000100:00100000:2.0:1788748309.109976:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6194:x1875638368601984:12345-192.168.203.22@tcp:502: Request processed in 219us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748309.109993:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:0.0:1788748309.113826:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748309.113997:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368602112 00000100:00100000:1.0:1788748309.114010:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368602112 00000100:00100000:1.0:1788748309.114115:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:1.0:1788748309.114128:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6194:x1875638368602112:12345-192.168.203.22@tcp:502: 00000100:00100000:1.0:1788748309.114354:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6194:x1875638368602112:12345-192.168.203.22@tcp:502: Request processed in 227us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748309.114364:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:3.0:1788748309.118530:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748309.118579:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748309.118659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368602240 00000100:00100000:1.0:1788748309.118673:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368602240 00000100:00100000:1.0:1788748309.118739:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368602496 00000100:00100000:1.0:1788748309.118743:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368602496 00000100:00100000:1.0:1788748309.118772:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1788748309.118783:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2409:x1875638368602240:12345-192.168.203.22@tcp:38: 00010000:00080000:1.0:1788748309.118821:0:6510:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1788748309.118885:0:6510:0:(genops.c:1384:class_connect()) connect: client 53dfbad0-5125-4663-8fa7-3e1aae0338a8, cookie 0x9ba0f20a02e19f56 00000004:00100000:1.0:1788748309.118919:0:6510:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788748309.119130:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1788748309.119138:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2409:x1875638368602496:12345-192.168.203.22@tcp:38: 00010000:00080000:0.0:1788748309.119158:0:6511:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from 53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1788748309.119196:0:6511:0:(genops.c:1384:class_connect()) connect: client 53dfbad0-5125-4663-8fa7-3e1aae0338a8, cookie 0x9ba0f20a02e19f5d 00000004:00100000:0.0:1788748309.119213:0:6511:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788748309.119732:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8addbf54b800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788748309.119753:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8adc83e50800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748309.119878:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2409:x1875638368602496:12345-192.168.203.22@tcp:38: Request processed in 737us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748309.119888:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1788748309.120294:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2409:x1875638368602240:12345-192.168.203.22@tcp:38: Request processed in 1510us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748309.120304:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1788748309.284654:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748309.284994:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388571776:0@lo:41: 00000100:00100000:2.0:1788748309.286580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748309.287011:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571776 00000100:00100000:0.0:1788748309.287024:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571776 00000100:00100000:0.0:1788748309.287133:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788748309.287145:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388571776:12345-0@lo:41: 00000004:00000024:0.0:1788748309.287206:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788748309.287289:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388571776:12345-0@lo:41: Request processed in 146us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748309.287296:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748309.288258:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388571776:0@lo:41: 00010000:00010000:0.0:1788748309.796724:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748310.134820:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748310.134926:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368602752 00000100:00100000:1.0:1788748310.134940:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368602752 00000100:00080000:3.0:1788748310.135086:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748310.135387:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1788748310.135420:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368602752:12345-192.168.203.22@tcp:41: 00000004:00000024:1.0:1788748310.135479:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788748310.135865:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368602752:12345-192.168.203.22@tcp:41: Request processed in 448us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748310.135874:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788748310.143544:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748310.143830:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748310.145619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368602624 00000100:00100000:1.0:1788748310.145619:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368602368 00000100:00100000:3.0:1788748310.145642:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368602624 00000100:00100000:1.0:1788748310.145642:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368602368 00000100:00100000:1.0:1788748310.145765:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1788748310.145778:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:0:x1875638368602368:12345-192.168.203.22@tcp:41: 00000004:00000024:1.0:1788748310.145822:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788748310.145920:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:0:x1875638368602368:12345-192.168.203.22@tcp:41: Request processed in 144us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748310.145929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788748310.145958:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1788748310.145969:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:0:x1875638368602624:12345-192.168.203.22@tcp:41: 00000004:00000024:3.0:1788748310.145999:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748310.146034:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:0:x1875638368602624:12345-192.168.203.22@tcp:41: Request processed in 67us (2204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748310.146041:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00080000:2.0:1788748310.150365:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748310.150636:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748310.150733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368602880 00000100:00100000:2.0:1788748310.150747:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368602880 00000100:00100000:2.0:1788748310.150809:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1788748310.150819:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368602880:12345-192.168.203.22@tcp:40: 00000100:00100000:2.0:1788748310.150938:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368602880:12345-192.168.203.22@tcp:40: Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748310.150945:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1788748310.155479:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748310.155666:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603008 00000100:00100000:1.0:1788748310.155676:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603008 00000100:00100000:1.0:1788748310.155732:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788748310.155741:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875638368603008:12345-192.168.203.22@tcp:8: 00010000:00080000:1.0:1788748310.155780:0:8424:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1788748310.155816:0:8424:0:(genops.c:1384:class_connect()) connect: client 53dfbad0-5125-4663-8fa7-3e1aae0338a8, cookie 0x9ba0f20a02e19f64 00002000:00100000:1.0:1788748310.155829:0:8424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 53dfbad0-5125-4663-8fa7-3e1aae0338a8/ffff8addbf54c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788748310.155848:0:8424:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788748310.156090:0:8424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788748310.156121:0:8424:0:(import.c:65:import_set_state_nolock()) ffff8addbf54a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748310.156237:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2409:x1875638368603008:12345-192.168.203.22@tcp:8: Request processed in 495us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748310.156265:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788748310.159863:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748310.160921:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748310.161124:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603392 00000100:00100000:1.0:1788748310.161134:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603392 00000100:00100000:1.0:1788748310.161191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1788748310.161203:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368603392:12345-192.168.203.22@tcp:900: 00000100:00100000:1.0:1788748310.161295:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368603392:12345-192.168.203.22@tcp:900: Request processed in 95us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748310.161302:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1788748310.161605:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748310.162044:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603136 00000100:00100000:3.0:1788748310.162051:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603136 00000100:00100000:3.0:1788748310.162080:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788748310.162088:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2409:x1875638368603136:12345-192.168.203.22@tcp:8: 00010000:00080000:3.0:1788748310.162119:0:8427:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1788748310.162149:0:8427:0:(genops.c:1384:class_connect()) connect: client 53dfbad0-5125-4663-8fa7-3e1aae0338a8, cookie 0x9ba0f20a02e19f6b 00002000:00100000:3.0:1788748310.162162:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 53dfbad0-5125-4663-8fa7-3e1aae0338a8/ffff8adc83d29800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788748310.162193:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788748310.163058:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788748310.163097:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8adc83d2c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748310.163167:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2409:x1875638368603136:12345-192.168.203.22@tcp:8: Request processed in 1078us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748310.163175:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1788748310.166164:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748310.166370:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603520 00000100:00100000:0.0:1788748310.166381:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603520 00000100:00100000:0.0:1788748310.166492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1788748310.166502:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368603520:12345-192.168.203.22@tcp:33: 00000100:00100000:2.0:1788748310.166815:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603264 00000100:00100000:2.0:1788748310.166821:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603264 00000100:00100000:2.0:1788748310.166849:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:2.0:1788748310.166856:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368603264:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1788748310.166928:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368603264:12345-192.168.203.22@tcp:400: Request processed in 73us (7076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748310.166935:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 195 00000004:00080000:3.0:1788748310.186069:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19410us 00000004:00200000:3.0:1788748310.203487:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788748310.203607:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6169:x1875638368603520:12345-192.168.203.22@tcp:33: Request processed in 37100us (37445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748310.203634:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788748310.392483:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748310.392707:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603648 00000100:00100000:3.0:1788748310.392717:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603648 00000100:00100000:3.0:1788748310.392784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788748310.392795:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6212:x1875638368603648:12345-192.168.203.22@tcp:101: 00010000:00010000:3.0:1788748310.392815:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748310.392884:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77200/0x9ba0f20a02e19f72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ab1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748310.393077:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e19f79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748310.393092:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e19f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748310.393108:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e19f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748310.393179:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788748310.393183:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748310.393197:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e19f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748310.393224:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77200/0x9ba0f20a02e19f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ab1 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748310.393243:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e19f79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ab1 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748310.393406:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113900) 00010000:00010000:3.0:1788748310.393409:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748310.393413:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76600, rc 0) 00000100:00100000:3.0:1788748310.393482:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:6212:x1875638368603648:12345-192.168.203.22@tcp:101: Request processed in 689us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748310.393491:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00010000:00010000:2.0:1788748310.821457:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748311.332831:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388571904:0@lo:41: 00000100:00100000:2.0:1788748311.332923:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748311.333061:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388571904 00000100:00100000:0.0:1788748311.333070:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388571904 00000100:00100000:0.0:1788748311.333125:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788748311.333135:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388571904:12345-0@lo:41: 00000004:00000024:0.0:1788748311.333170:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788748311.333234:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388571904:12345-0@lo:41: Request processed in 90us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748311.333241:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748311.333494:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388571904:0@lo:41: 00000100:00100000:1.0:1788748311.846117:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388572032:0@lo:13: 00000100:00100000:1.0:1788748311.846206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748311.846450:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572032 00000100:00100000:0.0:1788748311.846458:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572032 00000100:00100000:0.0:1788748311.846520:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748311.846531:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875638388572032:12345-0@lo:13: 00002000:00000024:0.0:1788748311.846554:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748311.846603:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875638388572032:12345-0@lo:13: Request processed in 74us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748311.846610:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788748311.846824:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748311.846949:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388572416:0@lo:400: 00000100:00100000:3.0:1788748311.846984:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.847005:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388572928:0@lo:400: 00000100:00100000:3.0:1788748311.847026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.847043:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388573440:0@lo:400: 00000100:00100000:3.0:1788748311.847062:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748311.847175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572416 00000100:00100000:0.0:1788748311.847180:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572416 00000100:00100000:0.0:1788748311.847208:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788748311.847216:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388572416:12345-0@lo:400: 00000100:00100000:0.0:1788748311.847255:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388572416:12345-0@lo:400: Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748311.847271:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788748311.847515:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572928 00000100:00100000:0.0:1788748311.847520:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572928 00000100:00100000:0.0:1788748311.847547:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573440 00000100:00100000:0.0:1788748311.847550:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573440 00000100:00100000:0.0:1788748311.847571:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748311.847578:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388572928:12345-0@lo:400: 00000100:00100000:0.0:1788748311.847613:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388572928:12345-0@lo:400: Request processed in 36us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748311.847620:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748311.847632:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748311.847638:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388573440:12345-0@lo:400: 00000100:00100000:0.0:1788748311.847665:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388573440:12345-0@lo:400: Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748311.847670:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748311.847837:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388572416:0@lo:400: 00010000:00080000:3.0:1788748311.847860:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc909500 x1875638388572928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748311.847871:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388572928:0@lo:400: 00010000:00080000:3.0:1788748311.847889:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc90aa00 x1875638388573440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748311.847897:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388573440:0@lo:400: 00000100:00100000:3.0:1788748311.847918:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788748311.847924:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388572288:0@lo:400: 00000100:00100000:3.0:1788748311.847952:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.847981:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388572800:0@lo:400: 00000100:00100000:3.0:1788748311.848000:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.848017:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388573312:0@lo:400: 00000100:00100000:3.0:1788748311.848037:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748311.848064:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572288 00000100:00100000:3.0:1788748311.848068:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572288 00000100:00100000:3.0:1788748311.848460:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572800 00000100:00100000:3.0:1788748311.848465:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572800 00000100:00100000:3.0:1788748311.848486:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573312 00000100:00100000:3.0:1788748311.848489:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573312 00000100:00100000:3.0:1788748311.848762:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788748311.848770:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388572288:12345-0@lo:400: 00000100:00100000:3.0:1788748311.848823:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388572288:12345-0@lo:400: Request processed in 55us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.848831:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788748311.848845:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748311.848851:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388572800:12345-0@lo:400: 00000100:00100000:3.0:1788748311.848894:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388572800:12345-0@lo:400: Request processed in 43us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.848899:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748311.848911:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788748311.848917:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388573312:12345-0@lo:400: 00000100:00100000:3.0:1788748311.848943:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388573312:12345-0@lo:400: Request processed in 27us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748311.848949:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788748311.848989:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388572288:0@lo:400: 00010000:00080000:3.0:1788748311.849001:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a3480 x1875638388572800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748311.849011:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388572800:0@lo:400: 00010000:00080000:3.0:1788748311.849019:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc90bb80 x1875638388573312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748311.849027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388573312:0@lo:400: 00000100:00080000:1.0:1788748311.849456:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748311.849462:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748311.849465:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748311.849484:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388572160:0@lo:400: 00000100:00100000:1.0:1788748311.849528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748311.849576:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388572672:0@lo:400: 00000100:00100000:1.0:1788748311.849605:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748311.849625:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388573184:0@lo:400: 00000100:00100000:1.0:1788748311.849664:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748311.849697:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788748311.849705:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388572544:0@lo:400: 00000100:00100000:1.0:1788748311.849727:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748311.849745:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388573056:0@lo:400: 00000100:00100000:1.0:1788748311.849778:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748311.849807:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573056 00000100:00100000:1.0:1788748311.849812:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573056 00000100:00100000:1.0:1788748311.849851:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748311.849858:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388573056:12345-0@lo:400: 00000100:00100000:1.0:1788748311.849897:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388573056:12345-0@lo:400: Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748311.849903:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748311.849925:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572672 00000100:00100000:1.0:1788748311.849928:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572672 00000100:00100000:1.0:1788748311.849945:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573184 00000100:00100000:1.0:1788748311.849947:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573184 00000100:00100000:1.0:1788748311.849960:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572544 00000100:00100000:1.0:1788748311.849962:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572544 00000100:00100000:1.0:1788748311.849974:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748311.849981:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388572672:12345-0@lo:400: 00000100:00100000:1.0:1788748311.850012:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388572672:12345-0@lo:400: Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748311.850018:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748311.850030:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788748311.850036:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388573184:12345-0@lo:400: 00000100:00100000:1.0:1788748311.850063:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388573184:12345-0@lo:400: Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748311.850069:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788748311.850951:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788748311.850969:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388572544:12345-0@lo:400: 00000100:00100000:1.0:1788748311.851026:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388572544:12345-0@lo:400: Request processed in 64us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748311.851044:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788748311.851075:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748311.851080:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748311.851211:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388572160 00000100:00100000:0.0:1788748311.851219:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388572160 00000100:00100000:0.0:1788748311.851257:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788748311.851265:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388572160:12345-0@lo:400: 00000100:00100000:0.0:1788748311.851335:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388572160:12345-0@lo:400: Request processed in 71us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748311.851341:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:0.0:1788748311.851417:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb537f800 x1875638388572032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748311.851441:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388572032:0@lo:13: 00000100:00100000:0.0:1788748311.851509:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388572544:0@lo:400: 00010000:00080000:0.0:1788748311.851534:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc908000 x1875638388573056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748311.851544:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388573056:0@lo:400: 00000100:00100000:0.0:1788748311.851552:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388572160:0@lo:400: 00000100:00100000:0.0:1788748311.851563:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388572672:0@lo:400: 00000100:00100000:0.0:1788748311.851574:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388573184:0@lo:400: 00000100:00100000:0.0:1788748311.852530:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388573568:0@lo:13: 00000100:00100000:0.0:1788748311.852581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748311.853020:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573568 00000100:00100000:2.0:1788748311.853034:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573568 00000100:00100000:2.0:1788748311.853183:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748311.853193:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388573568:12345-0@lo:13: 00002000:00000024:2.0:1788748311.853215:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748311.853271:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388573568:12345-0@lo:13: Request processed in 80us (690us total) trans 0 rc 0/0 00010000:00080000:1.0:1788748311.853363:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3a8b480 x1875638388573568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748311.853382:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388573568:0@lo:13: 00000001:00100000:1.0:1788748311.855026:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000001:00080000:1.0:1788748311.855045:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788748311.855056:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788748311.855246:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748312.357399:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748312.357424:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388573696:0@lo:13: 00000100:00100000:1.0:1788748312.357476:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748312.357489:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388573824:0@lo:13: 00000100:00100000:1.0:1788748312.357970:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748312.358184:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573824 00000100:00100000:0.0:1788748312.358192:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573824 00000100:00100000:0.0:1788748312.358242:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748312.358251:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388573824:12345-0@lo:13: 00002000:00000024:0.0:1788748312.358280:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748312.358352:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388573824:12345-0@lo:13: Request processed in 102us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748312.358359:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788748312.358518:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b0b800 x1875638388573824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748312.358537:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388573824:0@lo:13: 00000100:00100000:3.0:1788748312.363485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748312.363648:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573696 00000100:00100000:0.0:1788748312.363658:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573696 00000100:00100000:0.0:1788748312.363791:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748312.363803:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388573696:12345-0@lo:13: 00002000:00000024:0.0:1788748312.363840:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748312.363897:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388573696:12345-0@lo:13: Request processed in 97us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748312.363904:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788748312.363986:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb537f480 x1875638388573696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748312.364006:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388573696:0@lo:13: 00000100:00100000:1.0:1788748312.530969:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748312.531107:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603776 00000100:00100000:3.0:1788748312.531117:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603776 00000100:00100000:3.0:1788748312.531200:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1788748312.531225:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:6264:x1875638368603776:12345-192.168.203.22@tcp:41: 00000004:00000024:3.0:1788748312.531264:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788748312.531381:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:6264:x1875638368603776:12345-192.168.203.22@tcp:41: Request processed in 150us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748312.531388:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00080000:1.0:1788748312.531576:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748312.534884:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748312.537385:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368603904 00000100:00100000:2.0:1788748312.537400:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368603904 00000100:00080000:1.0:1788748312.537487:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748312.537505:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1788748312.537516:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6264:x1875638368603904:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1788748312.537554:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748312.537630:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6264:x1875638368603904:12345-192.168.203.22@tcp:41: Request processed in 117us (2756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748312.537638:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1788748312.540819:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748312.540952:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604032 00000100:00100000:1.0:1788748312.540964:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604032 00000100:00100000:1.0:1788748312.541054:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788748312.541068:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6264:x1875638368604032:12345-192.168.203.22@tcp:13: 00002000:00000024:1.0:1788748312.541103:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748312.541179:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:6264:x1875638368604032:12345-192.168.203.22@tcp:13: Request processed in 113us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748312.541187:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00080000:2.0:1788748312.541283:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748312.550561:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748312.554788:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604160 00000100:00100000:0.0:1788748312.554804:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604160 00000100:00100000:0.0:1788748312.554886:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788748312.554896:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:6264:x1875638368604160:12345-192.168.203.22@tcp:13: 00002000:00000024:0.0:1788748312.554928:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748312.555023:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:6264:x1875638368604160:12345-192.168.203.22@tcp:13: Request processed in 128us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748312.555030:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00080000:2.0:1788748312.555358:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788748312.868618:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748313.894482:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748314.413911:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748314.413946:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388573952:0@lo:41: 00000100:00100000:1.0:1788748314.414033:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748314.414116:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388573952 00000100:00100000:1.0:1788748314.414126:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388573952 00000100:00100000:1.0:1788748314.414183:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748314.414194:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388573952:12345-0@lo:41: 00000004:00000024:1.0:1788748314.414237:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788748314.414289:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388573952:12345-0@lo:41: Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748314.414297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748314.414391:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388573952:0@lo:41: 00010000:00010000:3.0:1788748314.917182:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788748314.922621:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000001:00100000:2.0:1788748314.922738:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000001:02000400:3.0:1788748315.140267:0:10177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788748315.447148:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748315.447203:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748315.447233:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748315.447264:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748315.447290:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748315.447342:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604544 00000100:00100000:0.0:1788748315.447351:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604544 00000100:00100000:0.0:1788748315.447422:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604416 00000100:00100000:0.0:1788748315.447426:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604416 00000100:00100000:0.0:1788748315.447452:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1788748315.447464:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368604544:12345-192.168.203.22@tcp:400: 00000100:00100000:0.0:1788748315.447555:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368604544:12345-192.168.203.22@tcp:400: Request processed in 93us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.447562:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1788748315.447579:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1788748315.447585:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368604416:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1788748315.447727:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604800 00000100:00100000:2.0:1788748315.447732:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604800 00000100:00100000:2.0:1788748315.447764:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604672 00000100:00100000:2.0:1788748315.447767:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604672 00000100:00100000:2.0:1788748315.447788:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788748315.447795:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368604800:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1788748315.447824:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368604800:12345-192.168.203.22@tcp:400: Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748315.447840:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788748315.447856:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1788748315.447862:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368604672:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1788748315.447888:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368604672:12345-192.168.203.22@tcp:400: Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748315.447894:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:2.0:1788748315.447936:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748315.447939:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748315.447942:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748315.447944:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788748315.448192:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604288 00000100:00100000:1.0:1788748315.448197:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604288 00000100:00100000:1.0:1788748315.448236:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:1.0:1788748315.448243:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368604288:12345-192.168.203.22@tcp:400: 00000100:00100000:1.0:1788748315.448275:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368604288:12345-192.168.203.22@tcp:400: Request processed in 33us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748315.448282:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:0.0:1788748315.448857:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368604416:12345-192.168.203.22@tcp:400: Request processed in 1268us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748315.448866:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00010000:00010000:3.0:1788748315.942650:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788748315.951583:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000100:00100000:2.0:1788748316.455222:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388574080:0@lo:41: 00000100:00100000:2.0:1788748316.455298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748316.455956:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574080 00000100:00100000:0.0:1788748316.455966:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574080 00000100:00100000:0.0:1788748316.456023:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788748316.456033:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388574080:12345-0@lo:41: 00000004:00000024:0.0:1788748316.456078:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788748316.456151:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388574080:12345-0@lo:41: Request processed in 120us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748316.456158:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788748316.456491:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388574080:0@lo:41: 00000100:00100000:3.0:1788748316.964602:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388574208:0@lo:13: 00000100:00100000:3.0:1788748316.964711:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748316.964783:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574208 00000100:00100000:0.0:1788748316.964797:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574208 00000100:00100000:0.0:1788748316.964889:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748316.964902:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388574208:12345-0@lo:13: 00002000:00000024:0.0:1788748316.964958:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748316.965057:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388574208:12345-0@lo:13: Request processed in 158us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748316.965065:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788748316.965124:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb537d180 x1875638388574208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748316.965138:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788748316.965171:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388574208:0@lo:13: 00000100:00100000:1.0:1788748316.965851:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388574336:0@lo:400: 00000100:00100000:3.0:1788748316.967196:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388574464:0@lo:400: 00000100:00100000:3.0:1788748316.967256:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748316.967367:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574464 00000100:00100000:0.0:1788748316.967375:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574464 00000100:00100000:0.0:1788748316.967432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788748316.967442:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388574464:12345-0@lo:400: 00000100:00100000:1.0:1788748316.967470:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748316.968794:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748316.968809:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388574848:0@lo:400: 00000100:00100000:0.0:1788748316.971822:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388574464:12345-0@lo:400: Request processed in 4371us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748316.971836:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788748316.972054:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748316.972128:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574336 00000100:00100000:2.0:1788748316.972137:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574336 00000100:00100000:2.0:1788748316.972179:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788748316.972189:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388574336:12345-0@lo:400: 00000100:00100000:2.0:1788748316.972258:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388574336:12345-0@lo:400: Request processed in 70us (6334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.972264:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788748316.972301:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388574592:0@lo:400: 00000100:00100000:2.0:1788748316.972353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748316.972381:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388575104:0@lo:400: 00000100:00100000:2.0:1788748316.972404:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748316.972423:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388575616:0@lo:400: 00000100:00100000:2.0:1788748316.972457:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748316.972479:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788748316.972486:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388574720:0@lo:400: 00000100:00100000:2.0:1788748316.972510:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748316.972530:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388575232:0@lo:400: 00000100:00100000:2.0:1788748316.972550:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748316.972566:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388575744:0@lo:13: 00000100:00100000:2.0:1788748316.972588:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748316.972621:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574592 00000100:00100000:2.0:1788748316.972625:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574592 00000100:00100000:2.0:1788748316.972661:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748316.972669:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388574592:12345-0@lo:400: 00010000:00010000:0.0:1788748316.972776:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748316.973820:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388574592:12345-0@lo:400: Request processed in 1148us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.973830:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748316.973865:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388575104 00000100:00100000:2.0:1788748316.973871:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388575104 00000100:00100000:2.0:1788748316.973910:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388575616 00000100:00100000:2.0:1788748316.973913:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388575616 00000100:00100000:2.0:1788748316.973929:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388575232 00000100:00100000:2.0:1788748316.973932:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388575232 00000100:00100000:2.0:1788748316.973945:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748316.973952:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388575104:12345-0@lo:400: 00000100:00100000:2.0:1788748316.973993:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388575104:12345-0@lo:400: Request processed in 42us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.973998:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788748316.974010:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748316.974016:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388575616:12345-0@lo:400: 00000100:00100000:2.0:1788748316.974055:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388575616:12345-0@lo:400: Request processed in 39us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.974060:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748316.974071:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748316.974077:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388575232:12345-0@lo:400: 00000100:00100000:2.0:1788748316.974101:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388575232:12345-0@lo:400: Request processed in 25us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.974106:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748316.974126:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574720 00000100:00100000:2.0:1788748316.974129:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574720 00000100:00100000:2.0:1788748316.974157:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788748316.974163:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388574720:12345-0@lo:400: 00000100:00100000:2.0:1788748316.974191:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388574720:12345-0@lo:400: Request processed in 29us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.974196:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788748316.974218:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748316.974221:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748316.974236:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388575744 00000100:00100000:2.0:1788748316.974239:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388575744 00000100:00100000:2.0:1788748316.974262:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748316.974268:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388575744:12345-0@lo:13: 00002000:00000024:2.0:1788748316.974281:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748316.974309:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388575744:12345-0@lo:13: Request processed in 42us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748316.974439:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388574720:0@lo:400: 00010000:00080000:0.0:1788748316.974453:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407ea00 x1875638388575232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748316.974463:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388575232:0@lo:400: 00010000:00080000:0.0:1788748316.974473:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407ed80 x1875638388575744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748316.974480:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788748316.974500:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388575744:0@lo:13: 00000100:00100000:0.0:1788748316.974511:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388574592:0@lo:400: 00010000:00080000:0.0:1788748316.974520:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407fb80 x1875638388575104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748316.974528:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388575104:0@lo:400: 00010000:00080000:0.0:1788748316.974537:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407e680 x1875638388575616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748316.974544:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388575616:0@lo:400: 00000100:00100000:2.0:1788748316.975173:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788748316.977559:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388574336:0@lo:400: 00000100:00100000:1.0:1788748316.977597:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388575360:0@lo:400: 00000100:00100000:1.0:1788748316.977674:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.977714:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788748316.977722:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388574976:0@lo:400: 00000100:00100000:1.0:1788748316.977751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748316.977782:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388575488:0@lo:400: 00000100:00100000:1.0:1788748316.977805:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748316.977855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748316.977881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388575360 00000100:00100000:2.0:1788748316.977889:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388575360 00000100:00100000:0.0:1788748316.977894:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574976 00000100:00100000:3.0:1788748316.977900:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388574464:0@lo:400: 00000100:00100000:0.0:1788748316.977901:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574976 00000100:00100000:2.0:1788748316.977946:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388575488 00000100:00100000:2.0:1788748316.977950:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388575488 00000100:00100000:1.0:1788748316.977961:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388574848 00000100:00100000:1.0:1788748316.977967:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388574848 00000100:00100000:2.0:1788748316.978129:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788748316.978139:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388575360:12345-0@lo:400: 00000100:00100000:1.0:1788748316.978153:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788748316.978159:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748316.978163:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388575488:12345-0@lo:400: 00000100:00100000:0.0:1788748316.978166:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388574976:12345-0@lo:400: 00000100:00100000:3.0:1788748316.978253:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388575360:0@lo:400: 00000100:00100000:0.0:1788748316.978403:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388574976:12345-0@lo:400: Request processed in 237us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748316.978406:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388575488:12345-0@lo:400: Request processed in 245us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748316.978413:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788748316.978425:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3a8a680 x1875638388574976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748316.978431:0:8447:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788748316.978443:0:8447:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788748316.978448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388574976:0@lo:400: 00010000:00080000:3.0:1788748316.978461:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407d180 x1875638388575488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748316.978469:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388575488:0@lo:400: 00000100:00100000:0.0:1788748316.978512:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788748316.978530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748316.978538:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388574848:12345-0@lo:400: 00000100:00100000:2.0:1788748316.978548:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388575360:12345-0@lo:400: Request processed in 405us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748316.978557:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788748316.978579:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748316.978584:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748316.978590:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388574848:12345-0@lo:400: Request processed in 52us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748316.978598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788748316.978610:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388574848:0@lo:400: 00000100:00100000:3.0:1788748317.481714:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388575872:0@lo:13: 00000100:00100000:3.0:1788748317.481802:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748317.482298:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388575872 00000100:00100000:1.0:1788748317.482311:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388575872 00000100:00100000:1.0:1788748317.482776:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788748317.482788:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388575872:12345-0@lo:13: 00002000:00000024:1.0:1788748317.482831:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748317.482910:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388575872:12345-0@lo:13: Request processed in 125us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748317.482918:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788748317.484575:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc908380 x1875638388575872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748317.484612:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388575872:0@lo:13: 00000100:00100000:2.0:1788748317.484639:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748317.484659:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388576000:0@lo:13: 00000100:00100000:2.0:1788748317.484728:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748317.487613:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388576000 00000100:00100000:3.0:1788748317.487631:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388576000 00000100:00100000:3.0:1788748317.487704:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748317.487717:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388576000:12345-0@lo:13: 00002000:00000024:3.0:1788748317.487751:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748317.487897:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388576000:12345-0@lo:13: Request processed in 182us (3168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748317.487906:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788748317.491175:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb537e680 x1875638388576000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748317.491212:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388576000:0@lo:13: 00010000:00010000:3.0:1788748317.988711:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788748318.889962:0:10325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa374afa0 20000000:00000080:3.0:1788748318.889988:0:10325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8addb5197800 uarg=0000000000000000 20000000:01000000:3.0:1788748318.890053:0:10325:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788748318.890057:0:10325:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788748318.890060:0:10325:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788748318.890066:0:10325:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788748318.890073:0:10325:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788748318.890151:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788748318.890155:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788748318.890963:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788748318.891736:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788748318.891779:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788748318.891805:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788748318.891817:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788748318.891821:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788748318.892260:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788748318.893014:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788748318.893044:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788748318.893060:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1788748318.893070:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788748318.893072:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788748318.893596:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788748318.893789:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788748318.893809:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788748318.893825:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788748318.893834:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788748318.893836:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788748318.894099:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788748318.894246:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788748318.894267:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788748318.894284:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788748318.894293:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788748318.894294:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788748318.895195:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788748318.895434:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788748318.895460:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788748318.895474:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:1.0:1788748318.895492:0:10325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788748318.895517:0:10325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895545:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895553:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895562:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895569:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895576:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895584:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895591:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895599:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895606:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895618:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895637:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895656:0:10325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895708:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895727:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 9 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.895745:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576128:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748318.895890:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895899:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 9 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.895908:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576256:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748318.895941:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.895950:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 23 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.895959:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576384:0@lo:104: 00000100:00100000:1.0:1788748318.896016:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748318.896057:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896065:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 23 pid: 6504 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.896073:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576512:0@lo:104: 00000100:00100000:1.0:1788748318.896094:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.896134:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388576384 00000100:00100000:1.0:1788748318.896143:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388576384 00000100:00100000:1.0:1788748318.896185:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388576512 00000100:00100000:1.0:1788748318.896188:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388576512 00000100:00100000:1.0:1788748318.896204:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748318.896214:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:10325:x1875638388576384:12345-0@lo:104: 00010000:00010000:1.0:1788748318.896228:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896281:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748318.896288:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:10325:x1875638388576384:12345-0@lo:104: Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.896295:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748318.896337:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748318.896344:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388576512:12345-0@lo:104: 00010000:00010000:1.0:1788748318.896352:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896383:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748318.896388:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388576512:12345-0@lo:104: Request processed in 45us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.896404:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788748318.896424:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748318.896431:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896439:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.896443:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896452:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.896459:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.896465:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.896494:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896501:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.896526:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896533:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e19f25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19f2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896546:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748318.896549:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896565:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.896569:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896575:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.896581:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.896587:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.896602:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896608:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.896614:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896620:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc941200/0x9ba0f20a02e19efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19f02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896630:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.896632:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.896634:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.896668:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896677:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 23 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.896697:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576896:0@lo:104: 00000100:00100000:1.0:1788748318.896723:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.896744:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388576896 00000100:00100000:1.0:1788748318.896749:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388576896 00000100:00100000:1.0:1788748318.896768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748318.896774:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388576896:12345-0@lo:104: 00010000:00010000:1.0:1788748318.896781:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896815:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748318.896821:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388576896:12345-0@lo:104: Request processed in 47us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.896827:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788748318.896842:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748318.896847:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896853:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.896857:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896864:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.896872:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.896878:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.896899:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896906:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.896923:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896930:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc941800/0x9ba0f20a02e19edf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ee6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.896941:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.896943:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.896944:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748318.896953:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748318.896966:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388577024:0@lo:103: 00000100:00100000:1.0:1788748318.896999:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748318.897036:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897046:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 23 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.897054:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577152:0@lo:104: 00000100:00100000:1.0:1788748318.897082:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.897112:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788748318.897123:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577152 00000100:00100000:1.0:1788748318.897127:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577152 00000100:00100000:1.0:1788748318.897146:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748318.897151:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83901050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388577152:12345-0@lo:104: 00010000:00010000:1.0:1788748318.897159:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897199:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748318.897205:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83901050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388577152:12345-0@lo:104: Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.897212:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788748318.897251:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748318.897255:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897262:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6a00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.897265:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897272:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.897278:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.897284:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.897311:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897343:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.897354:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897360:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f6a00/0x9ba0f20a02e19eb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ebc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897383:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.897384:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.897386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748318.897399:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388577280:0@lo:103: 00000100:00100000:1.0:1788748318.897425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.897456:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577024 00000100:00100000:1.0:1788748318.897459:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577024 00010000:00010000:1.0:1788748318.897478:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 24 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.897499:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577280 00000100:00100000:1.0:1788748318.897502:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577280 00010000:00010000:1.0:1788748318.897513:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 25 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.897532:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748318.897538:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add88431c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3638:x1875638388577024:12345-0@lo:103: 00010000:00010000:1.0:1788748318.897549:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748318.897555:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 25 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897565:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 25 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897583:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748318.897611:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add88431c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3638:x1875638388577024:12345-0@lo:103: Request processed in 74us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.897617:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788748318.897669:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748318.897675:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388577280:12345-0@lo:103: 00010000:00010000:1.0:1788748318.897681:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748318.897685:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 24 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897693:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 24 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897701:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748318.897719:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388577280:12345-0@lo:103: Request processed in 45us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.897724:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788748318.897761:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388577280:0@lo:103: 00000100:00100000:1.0:1788748318.897768:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388577024:0@lo:103: 00010000:00010000:1.0:1788748318.897799:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897807:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 23 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.897815:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577408:0@lo:104: 00000100:00100000:1.0:1788748318.897834:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.897851:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577408 00000100:00100000:1.0:1788748318.897854:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577408 00000100:00100000:1.0:1788748318.897869:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788748318.897879:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388577408:12345-0@lo:104: 00010000:00010000:1.0:1788748318.897889:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897928:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748318.897933:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388577408:12345-0@lo:104: Request processed in 58us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.897938:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1788748318.897952:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748318.897957:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897964:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fba00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.897968:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.897975:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.897981:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.897987:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.898001:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898007:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.898013:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898019:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e19e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19ea0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898041:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.898043:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.898045:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.898064:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898071:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 23 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.898080:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577664:0@lo:104: 00000100:00100000:1.0:1788748318.898103:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.898121:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577664 00000100:00100000:1.0:1788748318.898125:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577664 00000100:00100000:1.0:1788748318.898143:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788748318.898148:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388577664:12345-0@lo:104: 00010000:00010000:1.0:1788748318.898156:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898186:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748318.898191:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388577664:12345-0@lo:104: Request processed in 44us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748318.898197:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788748318.898211:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748318.898215:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898223:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.898226:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898239:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.898245:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.898250:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.898265:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898271:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.898276:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898283:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f6c00/0x9ba0f20a02e19e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e92 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.898294:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748318.903602:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748318.903664:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388576640:0@lo:103: 00000100:00100000:0.0:1788748318.903752:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748318.903796:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388577536:0@lo:103: 00000100:00100000:0.0:1788748318.903816:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748318.903844:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788748318.903850:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388576768:0@lo:103: 00000100:00100000:0.0:1788748318.903870:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748318.903888:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388577792:0@lo:103: 00000100:00100000:0.0:1788748318.903906:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748318.903943:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388576640 00000100:00100000:0.0:1788748318.903953:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388576640 00010000:00010000:0.0:1788748318.903996:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 24 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.904024:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577536 00000100:00100000:0.0:1788748318.904027:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577536 00010000:00010000:0.0:1788748318.904039:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 25 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.904050:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388576768 00000100:00100000:0.0:1788748318.904061:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388576768 00010000:00010000:0.0:1788748318.904077:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 26 pid: 6504 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.904090:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577792 00000100:00100000:0.0:1788748318.904092:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577792 00010000:00010000:0.0:1788748318.904103:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 27 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.904117:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748318.904126:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+27:3635:x1875638388576640:12345-0@lo:103: 00010000:00010000:0.0:1788748318.904143:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.904149:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 27 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904162:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 27 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904189:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.904228:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+27:3635:x1875638388576640:12345-0@lo:103: Request processed in 103us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.904236:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748318.904255:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788748318.904262:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+26:3635:x1875638388577536:12345-0@lo:103: 00010000:00010000:0.0:1788748318.904270:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.904275:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 26 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904284:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 26 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904307:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.904354:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+26:3635:x1875638388577536:12345-0@lo:103: Request processed in 92us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.904360:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788748318.904372:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748318.904378:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3635:x1875638388576768:12345-0@lo:103: 00010000:00010000:0.0:1788748318.904385:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.904389:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 25 pid: 6504 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904398:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 25 pid: 6504 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904407:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.904425:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3635:x1875638388576768:12345-0@lo:103: Request processed in 48us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.904431:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748318.904442:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748318.904447:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388577792:12345-0@lo:103: 00010000:00010000:0.0:1788748318.904454:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.904458:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 24 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904467:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 24 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.904476:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.904500:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388577792:12345-0@lo:103: Request processed in 54us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.904507:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748318.904558:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388576768:0@lo:103: 00000100:00100000:0.0:1788748318.904567:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388577792:0@lo:103: 00000100:00100000:0.0:1788748318.904574:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388576640:0@lo:103: 00000100:00100000:0.0:1788748318.904581:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388577536:0@lo:103: 00010000:00010000:2.0:1788748318.906767:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748318.906788:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 23 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.906806:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577920:0@lo:104: 00000100:00100000:2.0:1788748318.906879:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748318.906939:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748318.906959:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 23 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.906969:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388578048:0@lo:104: 00000100:00100000:2.0:1788748318.906992:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748318.907018:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748318.907026:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 23 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.907034:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388578176:0@lo:104: 00000100:00100000:2.0:1788748318.907054:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748318.907067:0:10325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788748318.907096:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb000/0x9ba0f20a02e19f2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19f25 expref: 23 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.907109:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576384:0@lo:104: 00010000:00010000:2.0:1788748318.907121:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbbe00/0x9ba0f20a02e19f02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19efb expref: 22 pid: 6504 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.907130:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576512:0@lo:104: 00010000:00010000:2.0:1788748318.907140:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e19ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19edf expref: 21 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.907148:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576896:0@lo:104: 00010000:00010000:2.0:1788748318.907159:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e19ebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19eb5 expref: 20 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.907175:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577152:0@lo:104: 00010000:00010000:2.0:1788748318.907189:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19e99 expref: 19 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.907199:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577408:0@lo:104: 00010000:00010000:2.0:1788748318.907210:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813fa400/0x9ba0f20a02e19e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19e8b expref: 18 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748318.907219:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577664:0@lo:104: 00000100:00100000:3.0:1788748318.907283:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388577920 00000100:00100000:3.0:1788748318.907292:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388577920 00000100:00100000:3.0:1788748318.907767:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578048 00000100:00100000:3.0:1788748318.907773:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578048 00000100:00100000:3.0:1788748318.907787:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578176 00000100:00100000:3.0:1788748318.907790:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578176 00000100:00100000:3.0:1788748318.907805:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748318.907816:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:10325:x1875638388577920:12345-0@lo:104: 00010000:00010000:3.0:1788748318.907834:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748318.907917:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748318.907923:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:10325:x1875638388577920:12345-0@lo:104: Request processed in 109us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748318.907940:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748318.907960:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788748318.907966:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:10325:x1875638388578048:12345-0@lo:104: 00010000:00010000:3.0:1788748318.907975:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748318.908009:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788748318.908014:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:10325:x1875638388578048:12345-0@lo:104: Request processed in 49us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748318.908019:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788748318.908029:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788748318.908035:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388578176:12345-0@lo:104: 00010000:00010000:3.0:1788748318.908042:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748318.908068:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788748318.908073:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10325:x1875638388578176:12345-0@lo:104: Request processed in 39us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748318.908078:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788748318.908213:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748318.909653:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748318.909739:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576128:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748318.909753:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388576256:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748318.909767:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388577920:0@lo:104: 00000100:00100000:2.0:1788748318.909775:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388578048:0@lo:104: 00000100:00100000:2.0:1788748318.909782:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875638388578176:0@lo:104: 00010000:00010000:2.0:1788748318.909841:0:10325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.909969:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605056 00000100:00100000:0.0:1788748318.909977:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605056 00010000:00010000:0.0:1788748318.910023:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 10 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.910060:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368604928 00000100:00100000:0.0:1788748318.910064:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368604928 00010000:00010000:0.0:1788748318.910077:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 11 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.910100:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1788748318.910109:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:2410:x1875638368605056:12345-192.168.203.22@tcp:103: 00010000:00010000:0.0:1788748318.910125:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.910131:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 11 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.910140:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 11 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.910162:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e19f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a41 expref: 11 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.910198:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.910266:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368605056:12345-192.168.203.22@tcp:103: Request processed in 158us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.910274:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1788748318.910294:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788748318.910302:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+9:2410:x1875638368604928:12345-192.168.203.22@tcp:103: 00010000:00010000:0.0:1788748318.910309:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.910413:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 9 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.910426:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 9 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.910437:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e19f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a48 expref: 9 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.910446:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.910467:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+8:2410:x1875638368604928:12345-192.168.203.22@tcp:103: Request processed in 166us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.910473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00010000:00010000:1.0:1788748318.910945:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748318.910955:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.910965:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.910970:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.910978:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.910985:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.911002:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.911046:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911053:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.911076:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911084:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e19e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e84 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911097:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748318.911100:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911106:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77e00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.911109:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911116:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.911123:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.911129:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.911142:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911148:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.911161:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911168:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d77e00/0x9ba0f20a02e19e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e45 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911179:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748318.911182:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911188:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6e00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748318.911191:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911198:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748318.911204:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748318.911210:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748318.911223:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911229:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748318.911245:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911252:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f6e00/0x9ba0f20a02e19e14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e1b expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748318.911266:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.911273:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.911275:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748318.911294:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388578304:0@lo:103: 00000100:00100000:1.0:1788748318.911396:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.911452:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748318.911459:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388578432:0@lo:103: 00000100:00100000:1.0:1788748318.911482:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748318.911503:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748318.911510:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388578560:0@lo:103: 00000100:00100000:1.0:1788748318.911532:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748318.911547:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748318.911550:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748318.911708:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748318.911721:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578304 00000100:00100000:0.0:1788748318.911727:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578304 00010000:00010000:0.0:1788748318.911754:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 18 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.911772:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578432 00000100:00100000:0.0:1788748318.911781:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578432 00010000:00010000:0.0:1788748318.911794:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 19 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.911806:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578560 00000100:00100000:0.0:1788748318.911808:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578560 00010000:00010000:0.0:1788748318.911818:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 20 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748318.911830:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748318.911837:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:3637:x1875638388578304:12345-0@lo:103: 00010000:00010000:0.0:1788748318.911849:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.911853:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 20 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.911864:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 20 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.911879:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e19e84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19e7d expref: 20 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.911892:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.911937:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:3637:x1875638388578304:12345-0@lo:103: Request processed in 99us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.911944:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748318.911959:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748318.911965:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:3637:x1875638388578432:12345-0@lo:103: 00010000:00010000:0.0:1788748318.911973:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.911977:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 18 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.911996:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 18 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912006:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e19e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19e3e expref: 18 pid: 6503 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912015:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.912039:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:3637:x1875638388578432:12345-0@lo:103: Request processed in 75us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.912046:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748318.912058:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748318.912064:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:3636:x1875638388578560:12345-0@lo:103: 00010000:00010000:0.0:1788748318.912071:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748318.912075:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 16 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912085:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 16 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912095:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76000/0x9ba0f20a02e19e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19e14 expref: 16 pid: 6502 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912108:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912117:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912133:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912147:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912154:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912161:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912167:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748318.912171:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912179:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912194:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748318.912205:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748318.912238:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:3636:x1875638388578560:12345-0@lo:103: Request processed in 174us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748318.912244:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748318.912285:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388578560:0@lo:103: 00010000:00010000:2.0:1788748318.912489:0:10325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748318.912499:0:10325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748318.912506:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e19f80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748318.914415:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388578432:0@lo:103: 00000100:00100000:1.0:1788748318.914433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388578304:0@lo:103: 00010000:00010000:0.0:1788748319.013441:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748319.207311:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748319.207516:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605184 00000100:00100000:2.0:1788748319.207535:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605184 00000100:00100000:2.0:1788748319.207616:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:2.0:1788748319.207627:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+8:6183:x1875638368605184:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1788748319.207731:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748319.207762:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f7400/0x9ba0f20a02e19f87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ab8 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748319.207803:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f7400/0x9ba0f20a02e19f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ab8 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748319.207818:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f7400/0x9ba0f20a02e19f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ab8 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748319.207828:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f7400, rc 0) 00000100:00100000:2.0:1788748319.207918:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6183:x1875638368605184:12345-192.168.203.22@tcp:101: Request processed in 292us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748319.207925:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:0.0:1788748319.211098:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748319.211555:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605312 00000100:00100000:2.0:1788748319.211570:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605312 00000100:00100000:2.0:1788748319.211648:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:2.0:1788748319.211660:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6183:x1875638368605312:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1788748319.211862:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6183:x1875638368605312:12345-192.168.203.22@tcp:501: Request processed in 204us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748319.211870:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:1.0:1788748319.214849:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748319.215024:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605440 00000100:00100000:2.0:1788748319.215054:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605440 00000100:00100000:2.0:1788748319.215153:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:2.0:1788748319.215164:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6183:x1875638368605440:12345-192.168.203.22@tcp:503: 00000100:00100000:2.0:1788748319.215370:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6183:x1875638368605440:12345-192.168.203.22@tcp:503: Request processed in 207us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748319.215379:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:3.0:1788748319.221948:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748319.222132:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605568 00000100:00100000:0.0:1788748319.222147:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605568 00000100:00100000:0.0:1788748319.222224:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:0.0:1788748319.222254:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6658:x1875638368605568:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1788748319.222510:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6658:x1875638368605568:12345-192.168.203.22@tcp:502: Request processed in 258us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748319.222519:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:0.0:1788748319.227762:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748319.227875:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605696 00000100:00100000:2.0:1788748319.227957:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605696 00000100:00100000:2.0:1788748319.228061:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:2.0:1788748319.228073:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6658:x1875638368605696:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788748319.228275:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6658:x1875638368605696:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 203us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748319.228284:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:2.0:1788748319.235492:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748319.235588:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605824 00000100:00100000:1.0:1788748319.235605:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605824 00000100:00100000:1.0:1788748319.235693:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:1.0:1788748319.235704:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6183:x1875638368605824:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748319.235728:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748319.235751:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbba00/0x9ba0f20a02e19f8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3abf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748319.235788:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbba00/0x9ba0f20a02e19f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3abf expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748319.235800:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbba00/0x9ba0f20a02e19f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3abf expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748319.235827:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbba00, rc 0) 00000100:00100000:1.0:1788748319.236043:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368605824:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 339us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748319.236051:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:3.0:1788748319.240286:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748319.241823:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368605952 00000100:00100000:2.0:1788748319.241837:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368605952 00000100:00100000:2.0:1788748319.241907:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:2.0:1788748319.241919:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368605952:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748319.242044:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368605952:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 128us (1769us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748319.242052:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:2.0:1788748319.524860:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748319.524889:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388578688:0@lo:41: 00000100:00100000:2.0:1788748319.525393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748319.529900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578688 00000100:00100000:1.0:1788748319.529915:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578688 00000100:00100000:1.0:1788748319.530041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788748319.530052:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388578688:12345-0@lo:41: 00000004:00000024:1.0:1788748319.530101:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748319.530190:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388578688:12345-0@lo:41: Request processed in 141us (4798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748319.530198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788748319.530312:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388578688:0@lo:41: 00010000:00010000:0.0:1788748320.040826:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748320.568902:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748320.569042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748320.569077:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748320.569093:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748320.569155:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606464 00000100:00100000:1.0:1788748320.569165:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606464 00000100:00100000:0.0:1788748320.569200:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748320.569221:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606592 00000100:00100000:1.0:1788748320.569224:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606592 00000100:00100000:2.0:1788748320.569242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606208 00000100:00100000:2.0:1788748320.569247:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606208 00000100:00100000:1.0:1788748320.569253:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1788748320.569263:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368606464:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748320.569286:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606336 00000100:00100000:2.0:1788748320.569289:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606336 00000100:00100000:0.0:1788748320.569346:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788748320.569355:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368606592:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748320.569358:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368606464:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.569365:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1788748320.569388:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606080 00000100:00100000:1.0:1788748320.569392:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606080 00000100:00100000:0.0:1788748320.569393:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368606592:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748320.569398:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1788748320.569416:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:1.0:1788748320.569423:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368606080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748320.569458:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368606080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.569464:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:2.0:1788748320.569685:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1788748320.569693:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368606208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748320.569778:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368606208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.569786:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1788748320.569800:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788748320.569807:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368606336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748320.569833:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368606336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.569838:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00080000:2.0:1788748320.569859:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748320.569862:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748320.569865:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748320.569866:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1788748320.804427:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788748320.804436:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc838be800 from 48 10000000:01000000:0.0:1788748320.804443:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748320.804496:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.804508:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.804519:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748320.804560:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388578816:0@lo:101: 00000100:00100000:0.0:1788748320.804650:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.804704:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.804814:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578816 00000100:00100000:2.0:1788748320.804821:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578816 00000100:00100000:2.0:1788748320.804873:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788748320.804882:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+15:6507:x1875638388578816:12345-0@lo:101: 00010000:00010000:2.0:1788748320.804895:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748320.804909:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6c00/0x9ba0f20a02e19f9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19f95 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.804933:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6c00/0x9ba0f20a02e19f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19f95 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.804944:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6c00/0x9ba0f20a02e19f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19f95 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.804961:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6c00, rc 0) 00000100:00100000:2.0:1788748320.805007:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388578816:12345-0@lo:101: Request processed in 126us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.805014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788748320.805120:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388578816:0@lo:101: 00010000:00010000:0.0:1788748320.805135:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.805143:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748320.805200:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388578944:0@lo:501: 00000100:00100000:0.0:1788748320.805222:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.805241:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.805465:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388578944 00000100:00100000:2.0:1788748320.805469:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388578944 00000100:00100000:2.0:1788748320.805500:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788748320.805507:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388578944:12345-0@lo:501: 00000100:00100000:2.0:1788748320.805672:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388578944:12345-0@lo:501: Request processed in 164us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.805679:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788748320.811794:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388578944:0@lo:501: 00000100:00100000:1.0:1788748320.811856:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579072:0@lo:503: 00000100:00100000:1.0:1788748320.811933:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.813748:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.818712:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579072 00000100:00100000:2.0:1788748320.818726:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579072 00000100:00100000:2.0:1788748320.818793:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788748320.818807:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388579072:12345-0@lo:503: 00000100:00100000:2.0:1788748320.818974:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388579072:12345-0@lo:503: Request processed in 172us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.818981:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788748320.819106:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579072:0@lo:503: 00000100:00100000:3.0:1788748320.819726:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc908e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10358:1875638388579200:0@lo:502: 00000100:00100000:3.0:1788748320.819773:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748320.819816:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.819899:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579200 00000100:00100000:2.0:1788748320.819905:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579200 00000100:00100000:2.0:1788748320.819936:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788748320.819943:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10358:x1875638388579200:12345-0@lo:502: 00000100:00100000:2.0:1788748320.820040:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10358:x1875638388579200:12345-0@lo:502: Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.820047:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788748320.820149:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc908e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10358:1875638388579200:0@lo:502: 00000100:00100000:3.0:1788748320.820186:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc908e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10358:1875638388579328:0@lo:502: 00000100:00100000:3.0:1788748320.820213:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748320.820232:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.820713:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579328 00000100:00100000:2.0:1788748320.820719:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579328 00000100:00100000:2.0:1788748320.820754:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788748320.820761:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10358:x1875638388579328:12345-0@lo:502: 00000100:00100000:2.0:1788748320.820881:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:10358:x1875638388579328:12345-0@lo:502: Request processed in 119us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.820888:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788748320.829470:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc908e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10358:1875638388579328:0@lo:502: 00000040:00080000:0.0:1788748320.830368:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788748320.830452:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788748320.830545:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748320.830557:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.830569:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748320.830579:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788748320.830582:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788748320.830585:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788748320.830639:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.830648:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.830658:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.830686:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579456:0@lo:101: 00000100:00100000:1.0:1788748320.830746:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.830792:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.830795:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579456 00000100:00100000:2.0:1788748320.830802:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579456 00000100:00100000:2.0:1788748320.830856:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788748320.830866:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+16:6507:x1875638388579456:12345-0@lo:101: 00010000:00010000:2.0:1788748320.830880:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748320.830892:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19fa3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.830915:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fa3 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.830925:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fa3 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.830933:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6a00, rc 0) 00000100:00100000:2.0:1788748320.830977:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388579456:12345-0@lo:101: Request processed in 113us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.830983:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788748320.831189:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579456:0@lo:101: 00010000:00010000:1.0:1788748320.831202:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.831210:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.831259:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579584:0@lo:501: 00000100:00100000:1.0:1788748320.831285:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.831307:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.831425:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579584 00000100:00100000:2.0:1788748320.831430:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579584 00000100:00100000:2.0:1788748320.831462:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788748320.831468:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388579584:12345-0@lo:501: 00000100:00100000:2.0:1788748320.831586:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388579584:12345-0@lo:501: Request processed in 117us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.831593:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788748320.831697:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579584:0@lo:501: 00000100:00100000:1.0:1788748320.831724:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579712:0@lo:503: 00000100:00100000:1.0:1788748320.831761:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.831792:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748320.832376:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579712 00000100:00100000:0.0:1788748320.832393:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579712 00000100:00100000:0.0:1788748320.832427:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788748320.832434:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388579712:12345-0@lo:503: 00000100:00100000:0.0:1788748320.832529:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388579712:12345-0@lo:503: Request processed in 95us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748320.832536:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788748320.836638:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388579712:0@lo:503: 00000100:00100000:1.0:1788748320.837204:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10360:1875638388579840:0@lo:502: 00000100:00100000:1.0:1788748320.837273:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.837342:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.838259:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579840 00000100:00100000:2.0:1788748320.838267:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579840 00000100:00100000:2.0:1788748320.838312:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788748320.838336:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10360:x1875638388579840:12345-0@lo:502: 00000100:00100000:2.0:1788748320.838468:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10360:x1875638388579840:12345-0@lo:502: Request processed in 133us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.838485:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788748320.838805:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10360:1875638388579840:0@lo:502: 00000020:01000000:1.0:1788748320.838836:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748320.838847:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748320.838855:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788748320.838862:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788748320.838890:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10360:1875638388579968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.838929:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.838968:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.840623:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388579968 00000100:00100000:2.0:1788748320.840642:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388579968 00000100:00100000:2.0:1788748320.840701:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788748320.840711:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10360:x1875638388579968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748320.840856:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:10360:x1875638388579968:12345-0@lo:502:llog_process_th.0 Request processed in 146us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.840864:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788748320.841137:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10360:1875638388579968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748320.841166:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748320.841173:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748320.841175:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788748320.841179:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788748320.841855:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788748320.841885:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788748320.841895:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.841919:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748320.841932:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788748320.841935:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8addb53d9000 from 48 10000000:01000000:0.0:1788748320.841938:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748320.841969:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.841977:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.841988:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748320.842010:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.842056:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.842088:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eac2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.842153:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580096 00000100:00100000:1.0:1788748320.842158:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580096 00000100:00100000:1.0:1788748320.842635:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788748320.842646:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+17:6507:x1875638388580096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748320.842658:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748320.842670:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbbc00/0x9ba0f20a02e19fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19fb1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.842692:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbbc00/0x9ba0f20a02e19fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fb1 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.842702:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbbc00/0x9ba0f20a02e19fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fb1 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.842710:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbbc00, rc 0) 00000100:00100000:1.0:1788748320.842754:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388580096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.842761:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788748320.843840:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748320.843868:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.843877:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.843942:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.843978:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748320.844101:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580224 00000100:00100000:2.0:1788748320.844108:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580224 00000100:00100000:2.0:1788748320.844142:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788748320.844149:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388580224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.844256:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388580224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.844264:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788748320.844436:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11000 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.844450:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.844484:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.844522:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.844539:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11000 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.844552:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580352 00000100:00100000:1.0:1788748320.844555:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580352 00000100:00100000:1.0:1788748320.844582:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788748320.844589:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388580352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.844689:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388580352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.844696:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788748320.844730:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.844882:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10362:1875638388580480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.844913:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.844929:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580480 00000100:00100000:1.0:1788748320.844932:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580480 00000100:00100000:1.0:1788748320.844953:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788748320.844958:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10362:x1875638388580480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.845246:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10362:x1875638388580480:12345-0@lo:502:llog_process_th.0 Request processed in 286us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.845253:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788748320.845282:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.845293:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10362:1875638388580480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.845441:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10362:1875638388580608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.845530:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.845578:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.845651:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580608 00000100:00100000:2.0:1788748320.845656:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580608 00000100:00100000:2.0:1788748320.845720:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788748320.845727:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10362:x1875638388580608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748320.845814:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:10362:x1875638388580608:12345-0@lo:502:llog_process_th.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.845821:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788748320.846300:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10362:1875638388580608:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788748320.846456:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788748320.846673:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788748320.846694:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788748320.846703:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.846714:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748320.846724:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788748320.846727:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788748320.846730:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788748320.846756:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.846762:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.846768:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.846785:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.846813:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.846846:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.846847:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580736 00000100:00100000:2.0:1788748320.846852:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580736 00000100:00100000:2.0:1788748320.846887:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788748320.846895:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+18:6507:x1875638388580736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748320.846905:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748320.846916:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6000/0x9ba0f20a02e19fc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19fbf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.846936:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6000/0x9ba0f20a02e19fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fbf expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.846946:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6000/0x9ba0f20a02e19fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fbf expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.846954:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6000, rc 0) 00000100:00100000:2.0:1788748320.846993:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388580736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.846999:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788748320.847010:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748320.847021:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.847028:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.847070:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.847092:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748320.847103:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580864 00000100:00100000:1.0:1788748320.847103:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.847107:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580864 00000100:00100000:2.0:1788748320.847138:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788748320.847150:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388580864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.847454:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388580864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.847461:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788748320.847705:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.847733:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.847763:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.847780:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.847795:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388580992 00000100:00100000:2.0:1788748320.847800:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388580992 00000100:00100000:2.0:1788748320.847829:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788748320.847835:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388580992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.847919:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388580992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.847926:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788748320.848136:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388580992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.848558:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10363:1875638388581120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.848596:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.848645:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748320.848684:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388581120 00000100:00100000:0.0:1788748320.848690:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388581120 00000100:00100000:0.0:1788748320.848725:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788748320.848733:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:10363:x1875638388581120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.848826:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:10363:x1875638388581120:12345-0@lo:502:llog_process_th.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748320.848833:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788748320.848840:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10363:1875638388581120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748320.848861:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748320.848874:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748320.848877:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788748320.848883:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788748320.848902:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10363:1875638388581248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.848932:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.848954:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f113c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.848995:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388581248 00000100:00100000:2.0:1788748320.848999:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388581248 00000100:00100000:2.0:1788748320.849026:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788748320.849032:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:10363:x1875638388581248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748320.849102:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:10363:x1875638388581248:12345-0@lo:502:llog_process_th.0 Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.849108:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788748320.849435:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10363:1875638388581248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748320.849455:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748320.849463:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748320.849465:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788748320.849469:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788748320.849696:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788748320.849714:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788748320.849722:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.849733:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748320.849742:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788748320.850175:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8add8f106000 from 48 10000000:01000000:2.0:1788748320.850179:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788748320.850203:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.850211:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.850219:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748320.850232:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388581376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.850267:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748320.850301:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add82fb6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748320.850573:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388581376 00000100:00100000:0.0:1788748320.850580:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388581376 00000100:00100000:0.0:1788748320.850793:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788748320.850802:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:6507:x1875638388581376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748320.850815:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748320.850829:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941e00/0x9ba0f20a02e19fd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19fcd expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.850850:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941e00/0x9ba0f20a02e19fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fcd expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.850860:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941e00/0x9ba0f20a02e19fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fcd expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.850869:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941e00, rc 0) 00000100:00100000:0.0:1788748320.850913:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388581376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748320.850919:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788748320.856136:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388581376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748320.856165:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.856177:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748320.856271:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388581504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.856354:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.856393:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71ae300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.856510:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388581504 00000100:00100000:1.0:1788748320.856518:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388581504 00000100:00100000:1.0:1788748320.856565:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788748320.856573:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388581504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.856720:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388581504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.856727:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788748320.856813:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388581504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.856987:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388581632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.857049:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.857067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388581632 00000100:00100000:0.0:1788748320.857073:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388581632 00000100:00100000:3.0:1788748320.857076:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748320.857098:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788748320.857106:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388581632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.857191:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388581632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748320.857209:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788748320.857405:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388581632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.858117:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10364:1875638388581760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.858167:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.858281:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388581760 00000100:00100000:1.0:1788748320.858287:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388581760 00000100:00100000:1.0:1788748320.858347:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788748320.858355:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10364:x1875638388581760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.858452:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10364:x1875638388581760:12345-0@lo:502:llog_process_th.0 Request processed in 98us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.858459:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788748320.860922:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748320.860960:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10364:1875638388581760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.861031:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10364:1875638388581888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.861093:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.861115:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.861401:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388581888 00000100:00100000:1.0:1788748320.861408:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388581888 00000100:00100000:1.0:1788748320.861455:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788748320.862955:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10364:x1875638388581888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.863271:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:10364:x1875638388581888:12345-0@lo:502:llog_process_th.0 Request processed in 1714us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.863281:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788748320.869123:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10364:1875638388581888:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788748320.869173:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788748320.869400:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788748320.869422:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788748320.869433:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748320.869443:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748320.869454:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788748320.869457:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788748320.869459:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788748320.869770:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748320.869780:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748320.869789:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748320.869825:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.869892:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748320.869942:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.870796:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582016 00000100:00100000:1.0:1788748320.870806:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582016 00000100:00100000:1.0:1788748320.870855:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788748320.870864:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388582016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748320.870877:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748320.870890:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbae00/0x9ba0f20a02e19fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19fdb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.870911:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbae00/0x9ba0f20a02e19fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fdb expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.870918:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbae00/0x9ba0f20a02e19fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fdb expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.870924:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbae00, rc 0) 00000100:00100000:1.0:1788748320.870974:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388582016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.870980:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788748320.871001:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748320.871094:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.871104:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748320.871188:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.871220:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.871253:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.871643:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582144 00000100:00100000:1.0:1788748320.871649:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582144 00000100:00100000:1.0:1788748320.871686:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788748320.871694:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388582144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.871817:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388582144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.871824:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788748320.871950:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.871981:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.872019:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.872049:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.872274:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582272 00000100:00100000:1.0:1788748320.872279:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582272 00000100:00100000:1.0:1788748320.872310:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788748320.872342:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388582272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.872436:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388582272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.872442:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788748320.873406:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.876845:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10366:1875638388582400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.877458:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.877585:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582400 00000100:00100000:1.0:1788748320.877595:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582400 00000100:00100000:1.0:1788748320.877655:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788748320.877663:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10366:x1875638388582400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.877927:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.878804:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10366:x1875638388582400:12345-0@lo:502:llog_process_th.0 Request processed in 1137us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.878817:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788748320.880217:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10366:1875638388582400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748320.880260:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748320.880270:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748320.880273:0:10366:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788748320.880280:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788748320.880339:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10366:1875638388582528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.880399:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.880445:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.880451:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582528 00000100:00100000:1.0:1788748320.880458:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582528 00000100:00100000:1.0:1788748320.880515:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788748320.880524:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10366:x1875638388582528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.880659:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10366:x1875638388582528:12345-0@lo:502:llog_process_th.0 Request processed in 136us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.880666:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788748320.882030:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10366:1875638388582528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748320.882071:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748320.882079:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748320.882081:0:10366:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788748320.882086:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788748320.882664:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788748320.882691:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788748320.882701:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.882711:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748320.882734:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788748320.882737:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adda7357000 from 48 10000000:01000000:1.0:1788748320.882740:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788748320.882770:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.882778:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.882786:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.882806:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.882862:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.882914:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11000 going to sleep for 11 seconds 00000100:00100000:0.0:1788748320.882980:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582656 00000100:00100000:0.0:1788748320.882986:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582656 00000100:00100000:0.0:1788748320.883032:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788748320.883041:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388582656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748320.883053:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748320.883065:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e19ff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19fe9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.883095:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e19ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fe9 expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.883104:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e19ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19fe9 expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748320.883112:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940000, rc 0) 00000100:00100000:0.0:1788748320.883159:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388582656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748320.883165:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788748320.883245:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748320.883258:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.883267:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748320.883351:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.883380:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748320.883404:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add82fb6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788748320.883650:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582784 00000100:00100000:3.0:1788748320.883655:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582784 00000100:00100000:3.0:1788748320.883688:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788748320.883695:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388582784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.883802:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388582784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748320.883808:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788748320.883838:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.883867:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.883905:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748320.883919:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748320.883930:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388582912 00000100:00100000:3.0:1788748320.883933:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388582912 00000100:00100000:3.0:1788748320.883948:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788748320.883953:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388582912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.884027:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388582912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748320.884033:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788748320.884069:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388582912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748320.884753:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10367:1875638388583040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.884797:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.884821:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.884929:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583040 00000100:00100000:2.0:1788748320.884934:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583040 00000100:00100000:2.0:1788748320.884959:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788748320.884967:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10367:x1875638388583040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748320.885062:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10367:x1875638388583040:12345-0@lo:502:llog_process_th.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.885068:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788748320.885138:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10367:1875638388583040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.885177:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10367:1875638388583168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748320.885222:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748320.885252:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.885355:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583168 00000100:00100000:2.0:1788748320.885360:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583168 00000100:00100000:2.0:1788748320.885377:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788748320.885383:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10367:x1875638388583168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748320.885450:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10367:x1875638388583168:12345-0@lo:502:llog_process_th.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.885456:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788748320.885584:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10367:1875638388583168:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788748320.885602:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788748320.885885:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788748320.885914:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788748320.885923:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748320.885933:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748320.885942:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788748320.885944:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788748320.885947:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788748320.885972:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748320.885979:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748320.885988:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748320.886003:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.886035:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748320.886068:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.886109:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583296 00000100:00100000:2.0:1788748320.886113:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583296 00000100:00100000:2.0:1788748320.886143:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788748320.886150:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388583296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748320.886160:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748320.886171:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e19ff7 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.886193:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ff7 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.886425:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ff7 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.886461:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6200, rc 0) 00000100:00100000:2.0:1788748320.886668:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388583296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 517us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.886674:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788748320.887464:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748320.887688:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748320.887701:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748320.887928:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.887977:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748320.888046:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc7df780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748320.888080:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583424 00000100:00100000:3.0:1788748320.888097:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583424 00000100:00100000:3.0:1788748320.888178:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788748320.888187:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388583424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.888345:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388583424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748320.888352:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788748320.888421:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.888449:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.888499:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748320.888872:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc7df780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.888928:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583552 00000100:00100000:1.0:1788748320.888933:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583552 00000100:00100000:1.0:1788748320.888958:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788748320.888965:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388583552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.889098:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388583552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.889105:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788748320.889209:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748320.889776:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10368:1875638388583680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748320.889817:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748320.889849:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.889889:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583680 00000100:00100000:1.0:1788748320.889893:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583680 00000100:00100000:1.0:1788748320.889922:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788748320.889929:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10368:x1875638388583680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.890007:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10368:x1875638388583680:12345-0@lo:502:llog_process_th.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.890019:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788748320.890174:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10368:1875638388583680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748320.890210:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748320.890220:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748320.890223:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788748320.890229:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788748320.890249:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10368:1875638388583808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748320.890281:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748320.890301:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748320.890464:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583808 00000100:00100000:1.0:1788748320.890469:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583808 00000100:00100000:1.0:1788748320.890505:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788748320.890511:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10368:x1875638388583808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748320.890592:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10368:x1875638388583808:12345-0@lo:502:llog_process_th.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748320.890599:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788748320.890870:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10368:1875638388583808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748320.890892:0:10368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748320.890896:0:10368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748320.890898:0:10368:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788748320.890902:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788748320.891076:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788748320.891096:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788748320.891106:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.891117:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748320.891128:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788748320.891130:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8add9ea619c0 from 1 10000000:01000000:1.0:1788748320.891133:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788748320.891158:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.891166:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.891175:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.891190:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.891246:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.891284:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.891411:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388583936 00000100:00100000:2.0:1788748320.891417:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388583936 00000100:00100000:2.0:1788748320.891451:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788748320.891458:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388583936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748320.891468:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748320.891491:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f7600/0x9ba0f20a02e1a00c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a005 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.891522:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f7600/0x9ba0f20a02e1a00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a005 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.891532:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f7600/0x9ba0f20a02e1a00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a005 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748320.891541:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f7600, rc 0) 00000100:00100000:2.0:1788748320.891580:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388583936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748320.891587:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788748320.891790:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388583936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748320.891802:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a00c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.891811:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a00c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748320.891860:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388584064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748320.891886:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748320.891914:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82f11b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748320.891958:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388584064 00000100:00100000:2.0:1788748320.891963:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388584064 00000100:00100000:2.0:1788748320.892024:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788748320.892031:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388584064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748320.892100:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388584064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748320.892107:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788748320.892163:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388584064:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788748320.892187:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788748320.892193:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a00c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748320.892213:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a00c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.061368:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788748321.137577:0:10387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8777f0c0 20000000:00000080:3.0:1788748321.137593:0:10387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8addb5196c00 uarg=0000000000000000 20000000:01000000:3.0:1788748321.137645:0:10387:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788748321.137651:0:10387:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788748321.137655:0:10387:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788748321.138261:0:10388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788748321.138459:0:10387:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788748321.147421:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788748321.147458:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788748321.147473:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788748321.147488:0:10387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788748321.147506:0:10387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147540:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e19caf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147547:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147553:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147574:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147584:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147802:0:10387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147917:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.147934:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 9 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.147949:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584192:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748321.148062:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.148071:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 23 pid: 6504 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.148089:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584320:0@lo:104: 00000100:00100000:0.0:1788748321.148131:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748321.148164:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.148172:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 23 pid: 6503 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.148180:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584448:0@lo:104: 00000100:00100000:0.0:1788748321.148206:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748321.148235:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.148241:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 23 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.148250:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584576:0@lo:104: 00010000:00010000:0.0:1788748321.148275:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e19caf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.148283:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e19caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 23 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.148290:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584704:0@lo:104: 00000100:00100000:1.0:1788748321.148561:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788748321.148582:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748321.148594:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388584320 00000100:00100000:1.0:1788748321.148600:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388584320 00000100:00100000:1.0:1788748321.148642:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388584448 00000100:00100000:1.0:1788748321.148645:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388584448 00000100:00100000:1.0:1788748321.148655:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388584576 00000100:00100000:1.0:1788748321.148664:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388584576 00000100:00100000:1.0:1788748321.148678:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748321.148686:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:10387:x1875638388584320:12345-0@lo:104: 00010000:00010000:1.0:1788748321.148697:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.148756:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748321.148762:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:10387:x1875638388584320:12345-0@lo:104: Request processed in 77us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748321.148769:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748321.148786:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748321.148791:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83809050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:10387:x1875638388584448:12345-0@lo:104: 00010000:00010000:1.0:1788748321.148799:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.148832:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748321.148836:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83809050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:10387:x1875638388584448:12345-0@lo:104: Request processed in 46us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748321.148842:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748321.148883:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748321.148889:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10387:x1875638388584576:12345-0@lo:104: 00010000:00010000:1.0:1788748321.148897:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.148929:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788748321.148934:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10387:x1875638388584576:12345-0@lo:104: Request processed in 46us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748321.148939:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788748321.148961:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748321.148967:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.148973:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940a00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748321.148977:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.148985:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748321.148991:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748321.148997:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748321.149024:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149030:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748321.149048:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149054:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e19e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19e37 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149064:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748321.149068:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149074:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f7800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748321.149077:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149090:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748321.149096:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748321.149102:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748321.149115:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149119:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748321.149126:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149131:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e19d0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19d11 expref: -99 pid: 8418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149142:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748321.149145:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149149:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748321.149152:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149158:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748321.149163:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748321.149174:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748321.149187:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149192:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748321.149207:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149213:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f6800/0x9ba0f20a02e19cb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19cbd expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149221:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748321.149223:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748321.149225:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748321.149231:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748321.149249:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388584832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748321.149292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748321.149355:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748321.149361:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388584960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748321.149383:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748321.149411:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388585088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748321.149430:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748321.149461:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388584832 00000100:00100000:1.0:1788748321.149466:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388584832 00010000:00010000:1.0:1788748321.149485:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 24 pid: 6504 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748321.149506:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388584960 00000100:00100000:1.0:1788748321.149514:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388584960 00010000:00010000:1.0:1788748321.149528:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 25 pid: 6503 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748321.149540:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585088 00000100:00100000:1.0:1788748321.149543:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585088 00010000:00010000:1.0:1788748321.149553:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 26 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748321.149565:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748321.149571:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+26:3637:x1875638388584832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748321.149580:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748321.149585:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 26 pid: 6504 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149594:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 26 pid: 6504 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149611:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748321.149649:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+26:3637:x1875638388584832:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748321.149654:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748321.149667:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748321.149672:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3637:x1875638388584960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748321.149679:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748321.149683:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 25 pid: 6503 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149692:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 25 pid: 6503 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149713:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748321.149735:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3637:x1875638388584960:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748321.149741:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748321.149753:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748321.149759:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388585088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748321.149766:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748321.149770:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 24 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149778:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 24 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.149786:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748321.149809:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388585088:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748321.149814:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748321.149855:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388585088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748321.149877:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388584960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748321.149884:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388584832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748321.150049:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748321.150993:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748321.151029:0:10387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748321.151044:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584192:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748321.151051:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813fac00/0x9ba0f20a02e19e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19e30 expref: 23 pid: 6504 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.151071:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584320:0@lo:104: 00010000:00010000:0.0:1788748321.151078:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add8148bc00/0x9ba0f20a02e19d11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19d0a expref: 22 pid: 6503 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.151084:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584448:0@lo:104: 00010000:00010000:0.0:1788748321.151089:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add8148a400/0x9ba0f20a02e19cbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19cb6 expref: 21 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.151094:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584576:0@lo:104: 00000100:00100000:3.0:1788748321.151158:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388584704 00000100:00100000:3.0:1788748321.151164:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388584704 00000100:00100000:3.0:1788748321.151195:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748321.151203:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10387:x1875638388584704:12345-0@lo:104: 00010000:00010000:3.0:1788748321.151223:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748321.151277:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748321.151283:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:10387:x1875638388584704:12345-0@lo:104: Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748321.151290:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788748321.151346:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748321.151353:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.151359:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fb200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748321.151370:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.151377:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748321.151384:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748321.151388:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748321.151421:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.151428:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748321.151446:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.151452:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813fb200/0x9ba0f20a02e19ca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e19caf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.151469:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748321.151471:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748321.151472:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748321.151485:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388585216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748321.151516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748321.151548:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585216 00000100:00100000:1.0:1788748321.151552:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585216 00010000:00010000:1.0:1788748321.151568:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e19caf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 21 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748321.151588:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748321.151600:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3636:x1875638388585216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748321.151611:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748321.151615:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e19caf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 21 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.151633:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e19caf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 21 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748321.151646:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748321.151674:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3636:x1875638388585216:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748321.151680:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748321.151727:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388585216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748321.152727:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e19caf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e19ca8 expref: 20 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.152741:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875638388584704:0@lo:104: 00010000:00010000:0.0:1788748321.152769:0:10387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748321.155149:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748321.155504:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606720 00000100:00100000:0.0:1788748321.155519:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606720 00010000:00010000:0.0:1788748321.155561:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 10 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748321.155602:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1788748321.155612:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368606720:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748321.155636:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748321.155642:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 10 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155673:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 10 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155690:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e19f4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a80 expref: 10 pid: 6502 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155708:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155716:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155733:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155740:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155746:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155752:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155757:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748321.155761:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155768:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155802:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748321.155813:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748321.155873:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+9:2410:x1875638368606720:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 261us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748321.155881:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00010000:00010000:3.0:1788748321.157237:0:10387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748321.157255:0:10387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748321.157263:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a013 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748321.575351:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388585344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748321.575427:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748321.576671:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585344 00000100:00100000:0.0:1788748321.576682:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585344 00000100:00100000:0.0:1788748321.576747:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788748321.576757:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388585344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748321.576793:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788748321.576867:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388585344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748321.576875:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788748321.576989:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388585344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748322.084792:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388585600:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.084869:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.084933:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388586112:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.084956:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.084978:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388586624:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.084999:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.085025:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788748322.085030:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388585728:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.085072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.085090:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388586240:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.085110:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.085125:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388586752:0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.085156:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.085189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585728 00000100:00100000:1.0:1788748322.085198:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585728 00000100:00100000:1.0:1788748322.085255:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748322.085263:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388585728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748322.085346:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388585728:12345-0@lo:400:kworker.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748322.085354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748322.085399:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388585728:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085558:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388585856:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748322.085604:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388586368:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085636:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748322.085651:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388586880:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085670:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748322.085694:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788748322.085700:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388585472:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085724:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748322.085745:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388585984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748322.085791:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388586496:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085808:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748322.085821:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388587008:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748322.085859:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388586368 00000100:00100000:0.0:1788748322.085863:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388586368 00000100:00100000:0.0:1788748322.085890:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388586880 00000100:00100000:0.0:1788748322.085892:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388586880 00000100:00100000:0.0:1788748322.085903:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388586496 00000100:00100000:0.0:1788748322.085905:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388586496 00000100:00100000:0.0:1788748322.085916:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587008 00000100:00100000:0.0:1788748322.085918:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587008 00000100:00100000:0.0:1788748322.085930:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748322.085936:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388586368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.085973:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388586368:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.085979:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748322.085992:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748322.085998:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388586880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.086024:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388586880:12345-0@lo:400:kworker.0 Request processed in 27us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.086029:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748322.086039:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748322.086044:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388586496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.086068:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388586496:12345-0@lo:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.086083:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748322.086095:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748322.086101:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388587008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.086139:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388587008:12345-0@lo:400:kworker.0 Request processed in 38us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.086146:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748322.086164:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585472 00000100:00100000:0.0:1788748322.086167:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585472 00000100:00100000:0.0:1788748322.086189:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788748322.086196:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:3637:x1875638388585472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.086237:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:3637:x1875638388585472:12345-0@lo:400:kworker.0 Request processed in 41us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.086242:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788748322.086275:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388585472:0@lo:400:kworker.0 00010000:00080000:0.0:1788748322.086287:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bbb80 x1875638388586496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748322.086298:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388586496:0@lo:400:kworker.0 00010000:00080000:0.0:1788748322.086307:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840b9180 x1875638388587008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748322.086338:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388587008:0@lo:400:kworker.0 00010000:00080000:0.0:1788748322.086349:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840ba680 x1875638388586368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748322.086357:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388586368:0@lo:400:kworker.0 00010000:00080000:0.0:1788748322.086376:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bb100 x1875638388586880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748322.086384:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388586880:0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.086525:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585600 00000100:00100000:2.0:1788748322.086529:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585600 00000100:00100000:2.0:1788748322.086551:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388586112 00000100:00100000:2.0:1788748322.086554:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388586112 00000100:00100000:2.0:1788748322.086567:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388586624 00000100:00100000:2.0:1788748322.086569:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388586624 00000100:00100000:2.0:1788748322.086582:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388586240 00000100:00100000:2.0:1788748322.086584:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388586240 00000100:00100000:2.0:1788748322.086595:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388586752 00000100:00100000:2.0:1788748322.086597:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388586752 00000100:00100000:2.0:1788748322.086628:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585856 00000100:00100000:2.0:1788748322.086632:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585856 00000100:00100000:2.0:1788748322.086646:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788748322.086652:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388585600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.086701:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388585600:12345-0@lo:400:kworker.0 Request processed in 49us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.086707:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788748322.086720:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748322.086726:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388586112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.086753:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388586112:12345-0@lo:400:kworker.0 Request processed in 28us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.086758:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748322.086769:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788748322.086774:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388586624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.086799:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388586624:12345-0@lo:400:kworker.0 Request processed in 25us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.086804:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788748322.086814:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748322.086820:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388586240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.086844:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388586240:12345-0@lo:400:kworker.0 Request processed in 25us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.086849:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748322.086859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748322.086865:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388586752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.086910:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388586752:12345-0@lo:400:kworker.0 Request processed in 45us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.086921:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748322.086961:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788748322.086975:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388585856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.087015:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388585856:12345-0@lo:400:kworker.0 Request processed in 49us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.087021:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788748322.087057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388585984 00000100:00100000:2.0:1788748322.087068:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388585984 00000100:00100000:2.0:1788748322.087091:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788748322.087097:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388585984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748322.087127:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388585984:12345-0@lo:400:kworker.0 Request processed in 31us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.087132:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788748322.087154:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748322.087158:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748322.087160:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748322.087163:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788748322.087640:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748322.087754:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388585984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.087768:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388585856:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.087796:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748322.087833:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788748322.087869:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840baa00 x1875638388586240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748322.087879:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388586240:0@lo:400:kworker.0 00010000:00080000:0.0:1788748322.087891:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840b9c00 x1875638388586752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748322.087912:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388586752:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.087925:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388585600:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.087935:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388586112:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.087944:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388586624:0@lo:400:kworker.0 00000100:00100000:0.0:1788748322.087981:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587136 00000100:00100000:0.0:1788748322.087985:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587136 00000100:00100000:0.0:1788748322.088030:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788748322.088037:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388587136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748322.088065:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748322.088118:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388587136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.088125:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788748322.088154:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408ed80 x1875638388587136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748322.088166:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748322.090408:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748322.090428:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388587264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748322.090494:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.090601:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587264 00000100:00100000:3.0:1788748322.090608:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587264 00000100:00100000:3.0:1788748322.090663:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788748322.090672:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388587264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748322.090701:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748322.090754:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388587264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748322.090769:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788748322.091112:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408c700 x1875638388587264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748322.091131:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388587264:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1788748322.276408:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748322.276414:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc838be800 from 4 10000000:01000000:1.0:1788748322.276418:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748322.276468:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.276481:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.276492:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748322.276531:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388587392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748322.276672:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.276720:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc825046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748322.277404:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587392 00000100:00100000:0.0:1788748322.277413:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587392 00000100:00100000:0.0:1788748322.277509:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788748322.277520:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388587392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748322.277535:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748322.277551:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a01a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748322.277587:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748322.277597:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748322.277606:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941200, rc 0) 00000100:00100000:0.0:1788748322.277678:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388587392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.277685:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788748322.277768:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388587392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748322.277783:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.277792:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748322.277882:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388587520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748322.277921:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.281280:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587520 00000100:00100000:3.0:1788748322.281294:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587520 00000100:00100000:1.0:1788748322.281343:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc825046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748322.281683:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788748322.281697:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388587520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748322.281862:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388587520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (3940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.281869:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788748322.282041:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388587520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748322.282205:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388587648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748322.282385:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.285472:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc825046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748322.288028:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587648 00000100:00100000:2.0:1788748322.288042:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587648 00000100:00100000:2.0:1788748322.289792:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788748322.289806:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388587648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.290285:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388587648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 480us (7898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.290292:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788748322.290384:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388587648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.290582:0:10417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10417:1875638388587776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748322.290637:0:10417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.290661:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587776 00000100:00100000:2.0:1788748322.290666:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587776 00000100:00100000:2.0:1788748322.290688:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788748322.290694:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10417:x1875638388587776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748322.290762:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10417:x1875638388587776:12345-0@lo:502:llog_process_th.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.290770:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788748322.290810:0:10417:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83fe39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748322.290825:0:10417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10417:1875638388587776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748322.290846:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748322.293035:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748322.293044:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788748322.293121:0:10417:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc838be800 00000020:00000080:2.0:1788748322.293125:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788748322.293234:0:10417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10417:1875638388587904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748322.293330:0:10417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.293374:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388587904 00000100:00100000:2.0:1788748322.293381:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388587904 00000100:00100000:2.0:1788748322.293423:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788748322.293432:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10417:x1875638388587904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748322.293545:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:10417:x1875638388587904:12345-0@lo:502:llog_process_th.0 Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.293553:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788748322.293607:0:10417:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83fe39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748322.293638:0:10417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10417:1875638388587904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748322.293673:0:10417:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748322.293677:0:10417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748322.293678:0:10417:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788748322.293682:0:10417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788748322.293746:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788748322.293774:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748322.293787:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.293797:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748322.293807:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748322.293809:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8addb53d9000 from 4 10000000:01000000:2.0:1788748322.293812:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748322.293836:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.293843:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.296508:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748322.296551:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.296630:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.296678:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83fe39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748322.296706:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588032 00000100:00100000:2.0:1788748322.296714:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588032 00000100:00100000:2.0:1788748322.296752:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788748322.296760:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388588032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748322.296789:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748322.296804:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a028 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.296829:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.296841:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.296849:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6e00, rc 0) 00000100:00100000:2.0:1788748322.296896:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388588032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.296902:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788748322.296944:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748322.296958:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.296966:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748322.297025:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.297049:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.297062:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83fe39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748322.297072:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588160 00000100:00100000:2.0:1788748322.297075:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588160 00000100:00100000:2.0:1788748322.297090:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788748322.297096:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388588160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.297205:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388588160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.297211:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788748322.297237:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.297262:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.297299:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.297313:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83fe39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748322.297325:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588288 00000100:00100000:3.0:1788748322.297330:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588288 00000100:00100000:3.0:1788748322.297822:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788748322.298851:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388588288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.299005:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388588288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1176us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748322.299012:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788748322.299344:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748322.299550:0:10418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10418:1875638388588416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748322.299596:0:10418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.299640:0:10418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc825049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748322.300016:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588416 00000100:00100000:3.0:1788748322.300386:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588416 00000100:00100000:3.0:1788748322.300426:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788748322.300434:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10418:x1875638388588416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748322.300544:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10418:x1875638388588416:12345-0@lo:502:llog_process_th.0 Request processed in 110us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748322.300551:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788748322.300582:0:10418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10418:1875638388588416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748322.300609:0:10418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748322.300634:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748322.300637:0:10418:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788748322.300645:0:10418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8addb53d9000 00000020:00000080:1.0:1788748322.300647:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788748322.300714:0:10418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10418:1875638388588544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748322.300749:0:10418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.300774:0:10418:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc825049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748322.300786:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588544 00000100:00100000:1.0:1788748322.300791:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588544 00000100:00100000:1.0:1788748322.300808:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788748322.300814:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10418:x1875638388588544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748322.300880:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:10418:x1875638388588544:12345-0@lo:502:llog_process_th.0 Request processed in 65us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748322.300886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788748322.300935:0:10418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10418:1875638388588544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748322.300952:0:10418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748322.300956:0:10418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748322.300958:0:10418:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788748322.300960:0:10418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788748322.301022:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788748322.301040:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748322.301050:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.301183:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748322.301193:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748322.301196:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add8f106000 from 4 10000000:01000000:1.0:1788748322.301204:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748322.301227:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.301236:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.301244:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748322.301257:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748322.301296:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.301310:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc825049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748322.301339:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588672 00000100:00100000:1.0:1788748322.301343:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588672 00000100:00100000:1.0:1788748322.301362:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788748322.301367:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388588672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748322.301375:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748322.301386:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a036 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.301406:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.301415:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.301422:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb800, rc 0) 00000100:00100000:1.0:1788748322.301446:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388588672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748322.301459:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788748322.301752:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748322.301763:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748322.301772:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748322.301819:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748322.301844:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748322.301862:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc825049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748322.301879:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588800 00000100:00100000:1.0:1788748322.301882:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588800 00000100:00100000:3.0:1788748322.301909:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788748322.301917:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388588800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.302008:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388588800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748322.302014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788748322.302943:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.302977:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.303017:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.304216:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788748322.304238:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388588928 00000100:00100000:3.0:1788748322.304245:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388588928 00000100:00100000:3.0:1788748322.304285:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788748322.304293:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388588928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.305266:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388588928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 970us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748322.305275:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788748322.305686:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388588928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.313146:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10421:1875638388589056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748322.313229:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.313340:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748322.323135:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589056 00000100:00100000:0.0:1788748322.323151:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589056 00000100:00100000:1.0:1788748322.323344:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788748322.323354:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10421:x1875638388589056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748322.323700:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10421:x1875638388589056:12345-0@lo:502:llog_process_th.0 Request processed in 346us (10470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748322.323708:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788748322.324730:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10421:1875638388589056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748322.324769:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748322.324779:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748322.324782:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788748322.324791:0:10421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8add8f106000 00000020:00000080:3.0:1788748322.324793:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788748322.326464:0:10421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10421:1875638388589184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748322.326537:0:10421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.333772:0:10421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748322.337450:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589184 00000100:00100000:0.0:1788748322.337465:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589184 00000100:00100000:0.0:1788748322.337527:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788748322.337538:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10421:x1875638388589184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748322.337810:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:10421:x1875638388589184:12345-0@lo:502:llog_process_th.0 Request processed in 274us (11271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.337819:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788748322.337933:0:10421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10421:1875638388589184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748322.337983:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748322.337990:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748322.337993:0:10421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788748322.337997:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788748322.338138:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788748322.338159:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748322.338169:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748322.338181:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748322.338192:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748322.338204:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adda7357000 from 4 10000000:01000000:3.0:1788748322.338207:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748322.338238:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748322.338253:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748322.338263:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748322.338283:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388589312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.338340:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.338389:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748322.338557:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589312 00000100:00100000:0.0:1788748322.338563:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589312 00000100:00100000:0.0:1788748322.338607:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788748322.338623:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388589312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748322.338634:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748322.338648:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a044 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748322.338671:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748322.338680:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748322.338698:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940200, rc 0) 00000100:00100000:0.0:1788748322.338733:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388589312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.338738:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788748322.340189:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388589312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748322.340224:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748322.340236:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748322.340348:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388589440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.340402:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.340435:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748322.340450:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589440 00000100:00100000:0.0:1788748322.340456:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589440 00000100:00100000:0.0:1788748322.340505:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788748322.340514:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388589440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748322.340746:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388589440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.340754:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788748322.341737:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388589440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.341785:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388589568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748322.346252:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.346370:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748322.348900:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589568 00000100:00100000:2.0:1788748322.348916:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589568 00000100:00100000:2.0:1788748322.348994:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788748322.349003:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388589568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.349542:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388589568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 539us (3296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.349551:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788748322.349645:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388589568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.367270:0:10423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10423:1875638388589696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748322.368185:0:10423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.368230:0:10423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83fe39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748322.369214:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589696 00000100:00100000:0.0:1788748322.369225:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589696 00000100:00100000:0.0:1788748322.369294:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788748322.369304:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:10423:x1875638388589696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748322.369502:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:10423:x1875638388589696:12345-0@lo:502:llog_process_th.0 Request processed in 200us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.369510:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788748322.369728:0:10423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10423:1875638388589696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748322.369760:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748322.369776:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748322.369779:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788748322.369787:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adda7357000 00000020:00000080:3.0:1788748322.369790:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788748322.369886:0:10423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10423:1875638388589824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748322.369931:0:10423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748322.369962:0:10423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f6f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748322.376661:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589824 00000100:00100000:2.0:1788748322.376673:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589824 00000100:00100000:2.0:1788748322.376733:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788748322.376743:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:10423:x1875638388589824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748322.376926:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:10423:x1875638388589824:12345-0@lo:502:llog_process_th.0 Request processed in 184us (6994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.376934:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788748322.378458:0:10423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:10423:1875638388589824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748322.378509:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748322.378518:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748322.378520:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788748322.378525:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788748322.378598:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788748322.378629:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748322.378639:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.378649:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748322.599552:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388589952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748322.599635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748322.599790:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388589952 00000100:00100000:2.0:1788748322.599798:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388589952 00000100:00100000:2.0:1788748322.599843:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748322.599853:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388589952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748322.599883:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748322.600443:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388589952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 590us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.600458:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788748322.600486:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388590080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748322.600516:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788748322.600563:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407ed80 x1875638388589952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748322.600579:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388589952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748322.600855:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590080 00000100:00100000:3.0:1788748322.600862:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590080 00000100:00100000:3.0:1788748322.600894:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748322.600902:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388590080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748322.600915:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748322.600959:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388590080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748322.600965:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788748322.601255:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc90a300 x1875638388590080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748322.601270:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388590080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748322.619500:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748322.619563:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606848 00000100:00100000:2.0:1788748322.619573:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606848 00000100:00100000:2.0:1788748322.619639:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 270 00000100:00100000:2.0:1788748322.619651:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+9:6183:x1875638368606848:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748322.619668:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748322.619697:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ac6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.619728:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.619740:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748322.619749:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f6800, rc 0) 00000100:00100000:2.0:1788748322.619814:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368606848:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 165us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.619829:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 270 00000100:00100000:1.0:1788748322.637520:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748322.637611:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368606976 00000100:00100000:2.0:1788748322.637631:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368606976 00000100:00100000:2.0:1788748322.637695:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:2.0:1788748322.637706:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368606976:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.638084:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368606976:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 379us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.638094:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:1.0:1788748322.650371:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748322.650407:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368607104 00000100:00100000:2.0:1788748322.650416:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368607104 00000100:00100000:2.0:1788748322.650467:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:2.0:1788748322.650477:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368607104:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748322.650604:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6183:x1875638368607104:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 128us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748322.650621:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:1.0:1788748322.676353:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748322.676717:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368607232 00000100:00100000:0.0:1788748322.676728:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368607232 00000100:00100000:0.0:1788748322.676788:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 273 00000100:00100000:0.0:1788748322.676798:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6718:x1875638368607232:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748322.676941:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6718:x1875638368607232:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 144us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.676967:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 273 00000100:00100000:3.0:1788748322.699484:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748322.700295:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368607360 00000100:00100000:0.0:1788748322.700308:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368607360 00000100:00100000:0.0:1788748322.700377:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 274 00000100:00100000:0.0:1788748322.700388:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6718:x1875638368607360:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748322.700538:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:6718:x1875638368607360:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 151us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748322.700546:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 274 00010000:00010000:3.0:1788748323.109059:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748324.132499:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748324.644830:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748324.644859:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388590208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748324.644933:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748324.645113:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590208 00000100:00100000:1.0:1788748324.645123:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590208 00000100:00100000:1.0:1788748324.645184:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748324.645194:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388590208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748324.645244:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748324.645308:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388590208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748324.645342:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788748324.645425:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388590208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788748325.160406:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748325.698634:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748325.698694:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748325.698826:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368607616 00000100:00100000:2.0:1788748325.698839:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368607616 00000100:00100000:2.0:1788748325.698927:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1788748325.698941:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368607616:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.699043:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368607616:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 105us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.699083:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00080000:2.0:1788748325.699113:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748325.699551:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748325.699587:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748325.699626:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748325.699676:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368607488 00000100:00100000:2.0:1788748325.699683:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368607488 00000100:00100000:2.0:1788748325.699734:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 275 00000100:00100000:2.0:1788748325.699744:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368607488:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.699789:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368607488:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 47us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.699796:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 275 00000100:00100000:2.0:1788748325.699830:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368607744 00000100:00100000:2.0:1788748325.699834:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368607744 00000100:00100000:2.0:1788748325.699869:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:2.0:1788748325.699876:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368607744:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.699906:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368607744:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.699912:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00080000:2.0:1788748325.700027:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748325.707039:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368607872 00000100:00100000:3.0:1788748325.707060:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368607872 00000100:00100000:3.0:1788748325.707244:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608000 00000100:00100000:3.0:1788748325.707249:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608000 00000100:00100000:2.0:1788748325.707336:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1788748325.707352:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368607872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748325.707467:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368607872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 120us (8772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748325.707475:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00080000:0.0:1788748325.708707:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748325.708718:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748325.709080:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788748325.709095:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368608000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748325.709191:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368608000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 101us (9564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748325.709199:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00010000:00010000:3.0:1788748326.187040:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748326.692491:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748326.692525:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388590336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748326.692624:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748326.692717:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590336 00000100:00100000:1.0:1788748326.692728:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590336 00000100:00100000:1.0:1788748326.692784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788748326.692794:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388590336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748326.692847:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748326.692906:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388590336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748326.692914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788748326.692971:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388590336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748327.204593:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748327.204692:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748327.204878:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748327.204886:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590464 00000100:00100000:0.0:1788748327.204897:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590464 00000100:00100000:0.0:1788748327.204970:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748327.204982:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388590464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748327.205020:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748327.205079:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388590464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748327.205086:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788748327.205148:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788748327.205191:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3a89c00 x1875638388590464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748327.205214:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748327.207786:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388590592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748327.207806:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388590720:0@lo:400:kworker.0 00000100:00100000:2.0:1788748327.207891:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.207895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.208149:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388591104:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.208178:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.208198:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388591616:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.208379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.208400:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388592128:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.208575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.208623:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788748327.208630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388590976:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.208658:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.208678:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388591488:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.208699:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.208717:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388592000:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.208736:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.208772:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590592 00000100:00100000:3.0:1788748327.208780:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590592 00000100:00100000:3.0:1788748327.208920:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748327.208931:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388590592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748327.208963:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748327.209017:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388590592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.209025:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748327.209050:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388591104 00000100:00100000:3.0:1788748327.209062:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388591104 00000100:00100000:3.0:1788748327.209093:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388591488 00000100:00100000:3.0:1788748327.209096:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388591488 00000100:00100000:3.0:1788748327.209117:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592000 00000100:00100000:3.0:1788748327.209120:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592000 00000100:00100000:3.0:1788748327.209135:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748327.209141:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388591104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.209177:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388591104:12345-0@lo:400:kworker.0 Request processed in 37us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.209184:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748327.209196:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748327.209202:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388591488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.209231:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388591488:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.209237:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788748327.209248:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788748327.209254:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388592000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.209283:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388592000:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.209289:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788748327.209308:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388591616 00000100:00100000:3.0:1788748327.209312:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388591616 00000100:00100000:3.0:1788748327.209405:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592128 00000100:00100000:3.0:1788748327.209410:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592128 00000100:00100000:3.0:1788748327.209529:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748327.209538:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388591616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.209576:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388591616:12345-0@lo:400:kworker.0 Request processed in 40us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.209602:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748327.209616:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748327.209622:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388592128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.209653:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388592128:12345-0@lo:400:kworker.0 Request processed in 32us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.209659:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788748327.209683:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590976 00000100:00100000:3.0:1788748327.209687:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590976 00000100:00100000:3.0:1788748327.209726:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788748327.209734:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388590976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.209768:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388590976:12345-0@lo:400:kworker.0 Request processed in 36us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.209775:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788748327.210061:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388590976:0@lo:400:kworker.0 00010000:00080000:3.0:1788748327.210079:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdce00 x1875638388591488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748327.210092:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388591488:0@lo:400:kworker.0 00010000:00080000:3.0:1788748327.210104:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380d880 x1875638388592000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748327.210112:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388592000:0@lo:400:kworker.0 00010000:00080000:3.0:1788748327.210125:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3a88700 x1875638388590592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748327.210141:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388590592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748327.210164:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388591104:0@lo:400:kworker.0 00010000:00080000:3.0:1788748327.210175:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fddf80 x1875638388591616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748327.210184:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388591616:0@lo:400:kworker.0 00010000:00080000:3.0:1788748327.210192:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380fb80 x1875638388592128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748327.210200:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388592128:0@lo:400:kworker.0 00000100:00080000:3.0:1788748327.210271:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748327.210277:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748327.210280:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748327.210425:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590720 00000100:00100000:3.0:1788748327.210432:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590720 00000100:00100000:3.0:1788748327.210474:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788748327.210483:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388590720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.210527:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388590720:12345-0@lo:400:kworker.0 Request processed in 47us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.210535:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788748327.210677:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388591232:0@lo:400:kworker.0 00000100:00100000:2.0:1788748327.210719:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748327.210755:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388591744:0@lo:400:kworker.0 00000100:00100000:2.0:1788748327.210778:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748327.210904:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388590720:0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.210952:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388591232 00000100:00100000:0.0:1788748327.210959:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388591232 00000100:00100000:0.0:1788748327.211000:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788748327.211010:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388591232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748327.211043:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388591744 00000100:00100000:2.0:1788748327.211048:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388591744 00000100:00100000:0.0:1788748327.211060:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388591232:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748327.211068:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748327.211091:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748327.211099:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388591744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748327.211132:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388591744:12345-0@lo:400:kworker.0 Request processed in 35us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748327.211139:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788748327.211157:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748327.211176:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388591232:0@lo:400:kworker.0 00010000:00080000:2.0:1788748327.211187:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdea00 x1875638388591744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748327.211196:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388591744:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.211278:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388590848:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.211312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.211357:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388591360:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.211379:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.211407:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388591872:0@lo:400:kworker.0 00000100:00100000:3.0:1788748327.211427:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.211459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388590848 00000100:00100000:3.0:1788748327.211470:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388590848 00000100:00100000:3.0:1788748327.211497:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388591360 00000100:00100000:3.0:1788748327.211500:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388591360 00000100:00100000:3.0:1788748327.211522:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388591872 00000100:00100000:3.0:1788748327.211525:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388591872 00000100:00100000:3.0:1788748327.211541:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748327.211547:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388590848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.211571:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748327.211580:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388591360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.211631:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388591360:12345-0@lo:400:kworker.0 Request processed in 52us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748327.211637:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748327.211651:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788748327.211657:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388591872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.211684:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388591872:12345-0@lo:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748327.211690:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788748327.211709:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388590848:12345-0@lo:400:kworker.0 Request processed in 162us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.211715:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788748327.211716:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388590848:0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.211724:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388591360:0@lo:400:kworker.0 00000100:00100000:0.0:1788748327.211733:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388591872:0@lo:400:kworker.0 00000100:00080000:2.0:1788748327.211946:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748327.721122:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748327.721152:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388592256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748327.721236:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748327.721342:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592256 00000100:00100000:3.0:1788748327.721353:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592256 00000100:00100000:3.0:1788748327.721411:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748327.721422:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388592256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748327.721460:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748327.721513:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388592256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748327.721521:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788748327.721568:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407dc00 x1875638388592256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748327.721598:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388592256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748327.724220:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748327.724247:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388592384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748327.724352:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748327.724471:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592384 00000100:00100000:1.0:1788748327.724481:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592384 00000100:00100000:1.0:1788748327.724541:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788748327.724551:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388592384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748327.724576:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748327.724639:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388592384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748327.724645:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788748327.724688:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408c380 x1875638388592384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748327.724720:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388592384:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788748328.228550:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748328.648572:0:10687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788748329.257892:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748329.765350:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748329.765383:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388592512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748329.765488:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748329.765729:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592512 00000100:00100000:2.0:1788748329.765742:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592512 00000100:00100000:2.0:1788748329.765823:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788748329.765836:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388592512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748329.765882:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788748329.765939:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388592512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748329.765946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788748329.766140:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388592512:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748330.276556:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748330.824437:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748330.824490:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748330.824594:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608128 00000100:00100000:1.0:1788748330.824608:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608128 00000100:00100000:3.0:1788748330.826835:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608256 00000100:00100000:3.0:1788748330.826854:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608256 00000100:00080000:2.0:1788748330.828403:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748330.829531:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:1.0:1788748330.829555:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2413:x1875638368608128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748330.829675:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2413:x1875638368608128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 130us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748330.829683:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:3.0:1788748330.831753:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1788748330.831789:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368608256:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748330.831893:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368608256:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 111us (7400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748330.831901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1788748330.832177:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748330.832343:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748330.832418:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748330.832444:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608384 00000100:00100000:3.0:1788748330.832455:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608384 00000100:00100000:3.0:1788748330.832506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:3.0:1788748330.832514:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368608384:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748330.832554:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368608384:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748330.832571:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:3.0:1788748330.832592:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608512 00000100:00100000:3.0:1788748330.832596:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608512 00000100:00100000:3.0:1788748330.832622:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608640 00000100:00100000:3.0:1788748330.832626:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608640 00000100:00100000:3.0:1788748330.832649:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788748330.832656:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368608512:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748330.838349:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368608512:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 5655us (5969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748330.838376:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788748330.838465:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1788748330.838482:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368608640:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748330.838616:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368608640:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 141us (6245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748330.838623:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00080000:3.0:1788748330.838678:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748330.838686:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748330.838690:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788748331.302962:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748331.812832:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388592640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748331.812923:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748331.813039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592640 00000100:00100000:1.0:1788748331.813049:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592640 00000100:00100000:1.0:1788748331.813104:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788748331.813114:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388592640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748331.813156:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748331.813206:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388592640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748331.813214:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788748331.813271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388592640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748332.327190:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388592768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748332.327276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.327398:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592768 00000100:00100000:0.0:1788748332.327416:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592768 00000100:00100000:0.0:1788748332.327483:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748332.327493:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388592768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788748332.327529:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748332.327594:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388592768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.327602:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788748332.327626:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748332.327663:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3a89c00 x1875638388592768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748332.327684:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388592768:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788748332.327931:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748332.333509:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388593024:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.333610:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.333651:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388593536:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.333673:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.333694:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388594048:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.333713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.333755:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788748332.333761:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388593152:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.333785:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.333802:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388593664:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.333820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.333834:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388594176:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.333852:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.333884:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593024 00000100:00100000:0.0:1788748332.333901:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593024 00000100:00100000:0.0:1788748332.333947:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593536 00000100:00100000:0.0:1788748332.333951:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593536 00000100:00100000:0.0:1788748332.333975:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594048 00000100:00100000:0.0:1788748332.333978:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594048 00000100:00100000:2.0:1788748332.334433:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388592896:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.334479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.334515:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388593408:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.334567:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.334592:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388593920:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.334627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.334652:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388594432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748332.334685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.334709:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788748332.334715:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388593280:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.334755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.334773:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388593792:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.334801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.334826:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388594304:0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.334852:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748332.334895:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593152 00000100:00100000:2.0:1788748332.334901:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593152 00000100:00100000:2.0:1788748332.334938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593408 00000100:00100000:2.0:1788748332.334942:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593408 00000100:00100000:2.0:1788748332.334961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788748332.334972:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388593152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.336133:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593664 00000100:00100000:0.0:1788748332.336146:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593664 00000100:00100000:3.0:1788748332.336156:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593920 00000100:00100000:0.0:1788748332.336164:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594176 00000100:00100000:3.0:1788748332.336165:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593920 00000100:00100000:0.0:1788748332.336170:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594176 00000100:00100000:0.0:1788748332.336196:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593280 00000100:00100000:0.0:1788748332.336199:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593280 00000100:00100000:3.0:1788748332.336219:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388593792 00000100:00100000:3.0:1788748332.336226:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388593792 00000100:00100000:0.0:1788748332.336226:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748332.336242:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388593024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.336252:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594304 00000100:00100000:3.0:1788748332.336256:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594304 00000100:00100000:3.0:1788748332.336272:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748332.336280:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388593920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.339287:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388593920:12345-0@lo:400:kworker.0 Request processed in 2995us (4647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.339306:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748332.339377:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748332.339399:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388593792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.339494:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388593792:12345-0@lo:400:kworker.0 Request processed in 109us (4693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.339501:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748332.339514:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748332.339531:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388594304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.339597:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388594304:12345-0@lo:400:kworker.0 Request processed in 67us (4745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.339604:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748332.339715:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788748332.339725:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388593408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.339773:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388593408:12345-0@lo:400:kworker.0 Request processed in 50us (5206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.339780:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788748332.340435:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81180 x1875638388593792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748332.340454:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388593792:0@lo:400:kworker.0 00010000:00080000:3.0:1788748332.340470:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f80a80 x1875638388594304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748332.340480:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388594304:0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.340495:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388593408:0@lo:400:kworker.0 00010000:00080000:3.0:1788748332.340508:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f82680 x1875638388593920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748332.340517:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388593920:0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.341938:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788748332.341965:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388593536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.342078:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388593536:12345-0@lo:400:kworker.0 Request processed in 128us (8403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.342098:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788748332.342128:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788748332.342135:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388594048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.342171:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388594048:12345-0@lo:400:kworker.0 Request processed in 37us (8458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.342177:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788748332.342192:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788748332.342201:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388593664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.342239:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388593664:12345-0@lo:400:kworker.0 Request processed in 39us (8416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.342245:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788748332.342263:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788748332.342270:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388594176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748332.342311:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388593152:12345-0@lo:400:kworker.0 Request processed in 7338us (8520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.342332:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388594176:12345-0@lo:400:kworker.0 Request processed in 44us (8460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.342340:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748332.342354:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788748332.342358:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788748332.342366:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388593280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748332.342406:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388593280:12345-0@lo:400:kworker.0 Request processed in 41us (7650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748332.342411:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788748332.342489:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388593280:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.345485:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388593024:12345-0@lo:400:kworker.0 Request processed in 9236us (11864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.345501:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748332.345572:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388592896 00000100:00100000:0.0:1788748332.345582:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388592896 00000100:00100000:0.0:1788748332.345639:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788748332.345648:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388592896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.345728:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388592896:12345-0@lo:400:kworker.0 Request processed in 82us (11248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.345734:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788748332.345795:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388593152:0@lo:400:kworker.0 00010000:00080000:0.0:1788748332.345813:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81c00 x1875638388593664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748332.345825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388593664:0@lo:400:kworker.0 00010000:00080000:0.0:1788748332.345837:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f80700 x1875638388594176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748332.345856:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388594176:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.345870:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388593024:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.345881:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388593536:0@lo:400:kworker.0 00000100:00100000:0.0:1788748332.345891:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388594048:0@lo:400:kworker.0 00000100:00080000:0.0:1788748332.345951:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748332.345956:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748332.345960:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748332.345963:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748332.345974:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594432 00000100:00100000:0.0:1788748332.345978:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594432 00000100:00100000:0.0:1788748332.346279:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748332.346288:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388594432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748332.346310:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748332.346393:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388594432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (11709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.346400:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748332.346627:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388592896:0@lo:400:kworker.0 00010000:00080000:0.0:1788748332.346644:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81f80 x1875638388594432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748332.346663:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388594432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748332.838803:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388594560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748332.838895:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748332.839000:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594560 00000100:00100000:1.0:1788748332.839010:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594560 00000100:00100000:1.0:1788748332.839069:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748332.839098:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388594560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748332.839139:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748332.839193:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388594560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748332.839200:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788748332.839254:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408c380 x1875638388594560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748332.839277:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388594560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748332.841870:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388594688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748332.841956:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748332.842098:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594688 00000100:00100000:0.0:1788748332.842109:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594688 00000100:00100000:0.0:1788748332.842169:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748332.842180:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388594688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748332.842217:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748332.842270:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388594688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748332.842278:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788748332.843795:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81f80 x1875638388594688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748332.843829:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388594688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748333.349847:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748333.921143:0:10930:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing yml_node 00010000:00010000:3.0:1788748334.373683:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748334.886501:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388594816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748334.886674:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748334.886820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594816 00000100:00100000:1.0:1788748334.886831:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594816 00000100:00100000:1.0:1788748334.886888:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788748334.886899:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388594816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748334.886940:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748334.887031:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388594816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748334.887040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788748334.887145:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388594816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748335.396957:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748335.927108:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748335.927159:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748335.927206:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748335.927210:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608768 00000100:00100000:3.0:1788748335.927246:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608768 00000100:00100000:2.0:1788748335.927387:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609024 00000100:00100000:2.0:1788748335.927399:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609024 00000100:00100000:3.0:1788748335.927430:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00100000:3.0:1788748335.927447:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2411:x1875638368608768:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748335.927464:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368608896 00000100:00100000:2.0:1788748335.927469:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368608896 00000100:00100000:2.0:1788748335.927507:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:2.0:1788748335.927518:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368609024:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748335.927574:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2411:x1875638368608768:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 130us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748335.927586:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00100000:2.0:1788748335.927598:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368609024:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748335.927608:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:2.0:1788748335.927631:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1788748335.927640:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368608896:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:0.0:1788748335.927828:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748335.927833:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748335.928152:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368608896:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 512us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748335.928161:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:0.0:1788748335.942977:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748335.943135:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609152 00000100:00100000:3.0:1788748335.943148:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609152 00000100:00080000:0.0:1788748335.943356:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748335.943671:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1788748335.943687:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2409:x1875638368609152:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:3.0:1788748335.943840:0:8734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f64 00000100:00080000:3.0:1788748335.943854:0:8734:0:(import.c:65:import_set_state_nolock()) ffff8addbf54a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788748335.943921:0:8734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788748335.944172:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+2:2409:x1875638368609152:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 488us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748335.944182:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00010000:00010000:1.0:1788748335.946979:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748335.949266:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748335.952003:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609280 00000100:00100000:1.0:1788748335.952022:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609280 00000100:00100000:1.0:1788748335.952182:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1788748335.952194:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2409:x1875638368609280:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1788748335.952275:0:8424:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f6b 00000100:00080000:1.0:1788748335.952289:0:8424:0:(import.c:65:import_set_state_nolock()) ffff8adc83d2c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748335.952390:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788748335.952668:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+2:2409:x1875638368609280:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 475us (3430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748335.952677:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00010000:00010000:2.0:1788748335.953238:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748335.957471:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788748336.420570:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748336.933063:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748336.933097:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388594944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748336.933197:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748336.933584:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388594944 00000100:00100000:1.0:1788748336.933595:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388594944 00000100:00100000:1.0:1788748336.933666:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788748336.933677:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388594944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748336.933784:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748336.933907:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388594944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 231us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748336.933914:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788748336.934075:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388594944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748337.444728:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388595200:0@lo:400:kworker.0 00000100:00100000:1.0:1788748337.444796:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748337.444865:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388595712:0@lo:400:kworker.0 00000100:00100000:1.0:1788748337.444888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748337.444925:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388596224:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388595072:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445073:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.445100:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388595584:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445124:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.445154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388596096:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.445193:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388596608:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445211:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.445246:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595072 00000100:00100000:3.0:1788748337.445253:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595072 00000100:00100000:3.0:1788748337.445296:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788748337.445303:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388595072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445373:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388595072:12345-0@lo:400:kworker.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.445380:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788748337.445406:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595200 00000100:00100000:3.0:1788748337.445409:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595200 00000100:00100000:3.0:1788748337.445428:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595712 00000100:00100000:3.0:1788748337.445430:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595712 00000100:00100000:3.0:1788748337.445464:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788748337.445470:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388595200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445498:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388595200:12345-0@lo:400:kworker.0 Request processed in 29us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.445503:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788748337.445522:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788748337.445528:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388595712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445552:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388595712:12345-0@lo:400:kworker.0 Request processed in 24us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.445557:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788748337.445576:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596096 00000100:00100000:3.0:1788748337.445580:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596096 00000100:00100000:3.0:1788748337.445613:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596608 00000100:00100000:3.0:1788748337.445615:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596608 00000100:00100000:3.0:1788748337.445629:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748337.445634:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388596096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445660:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388596096:12345-0@lo:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.445666:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748337.445676:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788748337.445681:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388596608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445704:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388596608:12345-0@lo:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.445710:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788748337.445724:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748337.445728:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748337.445731:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748337.445757:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388595072:0@lo:400:kworker.0 00010000:00080000:3.0:1788748337.445770:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408f800 x1875638388596096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748337.445781:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388596096:0@lo:400:kworker.0 00010000:00080000:3.0:1788748337.445790:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408ed80 x1875638388596608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748337.445798:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388596608:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445836:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388595328:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.445877:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388595840:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.445904:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.445922:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388596352:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.446238:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.446259:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788748337.446266:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388595456:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.446285:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.446299:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388595968:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.446340:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.446353:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388596480:0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.446371:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.446392:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595840 00000100:00100000:3.0:1788748337.446396:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595840 00000100:00100000:3.0:1788748337.446419:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596352 00000100:00100000:3.0:1788748337.446422:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596352 00000100:00100000:1.0:1788748337.446547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748337.446657:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595584 00000100:00100000:2.0:1788748337.446661:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595584 00000100:00100000:2.0:1788748337.446686:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595328 00000100:00100000:2.0:1788748337.446689:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595328 00000100:00100000:2.0:1788748337.446703:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788748337.446710:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388595584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748337.446751:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388595584:12345-0@lo:400:kworker.0 Request processed in 42us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748337.446758:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788748337.446770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788748337.446776:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388595328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748337.446808:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388595328:12345-0@lo:400:kworker.0 Request processed in 32us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748337.446813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788748337.446873:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388595584:0@lo:400:kworker.0 00000100:00100000:2.0:1788748337.446886:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748337.446891:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388596736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748337.447000:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595456 00000100:00100000:3.0:1788748337.447004:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595456 00000100:00100000:3.0:1788748337.447024:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788748337.447030:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388595840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748337.447062:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388595840:12345-0@lo:400:kworker.0 Request processed in 33us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.447068:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788748337.447248:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788748337.447257:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388596352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.447292:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388596352:12345-0@lo:400:kworker.0 Request processed in 37us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.447297:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788748337.447340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748337.447373:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788748337.447380:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388595456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748337.447409:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388595456:12345-0@lo:400:kworker.0 Request processed in 30us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748337.447425:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788748337.449087:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388595200:0@lo:400:kworker.0 00000100:00100000:1.0:1788748337.449103:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388595712:0@lo:400:kworker.0 00010000:00010000:1.0:1788748337.449262:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748337.449445:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748337.449459:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388596864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748337.449511:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748337.449845:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596736 00000100:00100000:1.0:1788748337.449853:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596736 00000100:00100000:1.0:1788748337.449901:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596864 00000100:00100000:1.0:1788748337.449905:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596864 00000100:00100000:1.0:1788748337.449921:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748337.449929:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388596736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748337.449957:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748337.450007:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388596736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748337.450013:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748337.450028:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748337.450034:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388596864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748337.450044:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748337.450072:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388596864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748337.450078:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788748337.450107:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81880 x1875638388596864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748337.450125:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388596864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748337.450588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596224 00000100:00100000:3.0:1788748337.450594:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596224 00000100:00100000:3.0:1788748337.450620:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788748337.450628:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388596224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.452789:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388595968 00000100:00100000:0.0:1788748337.452801:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388595968 00000100:00100000:0.0:1788748337.452841:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596480 00000100:00100000:0.0:1788748337.452844:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596480 00000100:00100000:0.0:1788748337.452862:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748337.452870:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbcacdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388595968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.453099:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbcacdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388595968:12345-0@lo:400:kworker.0 Request processed in 226us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.453108:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748337.453248:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748337.453255:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388596480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.453392:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388596480:12345-0@lo:400:kworker.0 Request processed in 137us (7018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.453398:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788748337.454562:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380ce00 x1875638388596736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.454587:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388596736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748337.454636:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388595456:0@lo:400:kworker.0 00010000:00080000:0.0:1788748337.454650:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408d180 x1875638388595968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.454659:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388595968:0@lo:400:kworker.0 00010000:00080000:0.0:1788748337.454669:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408c700 x1875638388596480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.454676:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388596480:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.454688:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388595328:0@lo:400:kworker.0 00010000:00080000:0.0:1788748337.454697:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408dc00 x1875638388595840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.454705:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388595840:0@lo:400:kworker.0 00010000:00080000:0.0:1788748337.454731:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408ca80 x1875638388596352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.454738:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388596352:0@lo:400:kworker.0 00000100:00080000:0.0:1788748337.454790:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748337.454795:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748337.454798:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748337.454801:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748337.461647:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388596224:12345-0@lo:400:kworker.0 Request processed in 11008us (15088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.461683:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788748337.462155:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388596224:0@lo:400:kworker.0 00000100:00100000:0.0:1788748337.957854:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748337.957889:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388596992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748337.957977:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748337.958068:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388596992 00000100:00100000:0.0:1788748337.958089:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388596992 00000100:00100000:0.0:1788748337.958442:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748337.958454:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388596992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748337.958507:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748337.958589:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388596992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748337.958797:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788748337.958857:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81500 x1875638388596992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748337.958879:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388596992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748337.961465:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748337.961505:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388597120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748337.961599:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748337.961683:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388597120 00000100:00100000:3.0:1788748337.961692:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388597120 00000100:00100000:3.0:1788748337.961749:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788748337.961759:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388597120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748337.961789:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748337.961845:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388597120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748337.961855:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788748337.961907:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408df80 x1875638388597120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748337.961929:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388597120:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788748338.389848:0:11114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.41 00010000:00010000:3.0:1788748338.471305:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748339.492513:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748340.004864:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748340.004900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388597248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748340.004992:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748340.005478:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388597248 00000100:00100000:3.0:1788748340.005490:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388597248 00000100:00100000:3.0:1788748340.005611:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788748340.005624:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388597248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788748340.005668:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788748340.005755:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388597248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748340.005762:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788748340.005849:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388597248:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788748340.516731:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748341.056079:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748341.056128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748341.056173:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748341.056203:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609664 00000100:00100000:3.0:1788748341.056212:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609664 00000100:00100000:3.0:1788748341.056279:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609536 00000100:00100000:3.0:1788748341.056282:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609536 00000100:00100000:3.0:1788748341.056308:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1788748341.056343:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368609664:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748341.056416:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368609664:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748341.056425:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1788748341.056441:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:3.0:1788748341.056448:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368609536:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748341.056473:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368609536:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748341.056477:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:2.0:1788748341.056702:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609408 00000100:00100000:2.0:1788748341.056708:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609408 00000100:00100000:2.0:1788748341.056739:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00100000:2.0:1788748341.056746:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368609408:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748341.056782:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368609408:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748341.056789:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00080000:0.0:1788748341.056898:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748341.056903:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1788748341.094735:0:11211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.41 00010000:00010000:2.0:1788748341.543651:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748342.052574:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748342.052603:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388597376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748342.052697:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748342.053183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388597376 00000100:00100000:0.0:1788748342.053195:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388597376 00000100:00100000:0.0:1788748342.053265:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748342.053277:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388597376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748342.053358:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788748342.053424:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388597376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748342.053432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788748342.053657:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388597376:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788748342.054578:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:3.0:1788748342.054586:0:8419:0:(genops.c:885:class_export_put()) final put ffff8addbf54c000/53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:2.0:1788748342.055518:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf54c000/53dfbad0-5125-4663-8fa7-3e1aae0338a8 for lustre-OST0000 00000020:00000080:2.0:1788748342.055612:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf54a000 for lustre-OST0000 00000001:00100000:0.0:1788748342.061645:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:0.0:1788748342.061659:0:9505:0:(genops.c:885:class_export_put()) final put ffff8adc83d29800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:2.0:1788748342.070165:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83d29800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 for lustre-OST0001 00000020:00000080:2.0:1788748342.070235:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83d2c000 for lustre-OST0001 00010000:00010000:2.0:1788748342.565051:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748342.565380:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748342.565411:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388597504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748342.565527:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748342.566125:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388597504 00000100:00100000:1.0:1788748342.566156:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388597504 00000100:00100000:1.0:1788748342.566252:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788748342.566266:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388597504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748342.566310:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748342.566380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388597632:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.566396:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388597504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.566403:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748342.566420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748342.566450:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388598144:0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.566492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788748342.566499:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748342.566513:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388598016:0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.566515:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388598656:0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.566542:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748342.566564:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788748342.566568:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598144 00000100:00100000:2.0:1788748342.566570:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388597760:0@lo:400:kworker.0 00000100:00100000:3.0:1788748342.566572:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598144 00000100:00100000:2.0:1788748342.566591:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748342.566608:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388598272:0@lo:400:kworker.0 00000100:00100000:3.0:1788748342.566609:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598656 00000100:00100000:3.0:1788748342.566619:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598656 00000100:00100000:2.0:1788748342.566627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748342.566636:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388597760 00000100:00100000:3.0:1788748342.566638:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388597760 00000100:00100000:2.0:1788748342.566640:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388598784:0@lo:400:kworker.0 00000100:00100000:3.0:1788748342.566650:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598272 00000100:00100000:3.0:1788748342.566652:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598272 00000100:00100000:2.0:1788748342.566658:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748342.566664:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598784 00000100:00100000:3.0:1788748342.566666:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598784 00000100:00100000:3.0:1788748342.566681:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788748342.566688:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388598144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788748342.566702:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748342.566705:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748342.566714:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748342.566729:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388598528:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.566779:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598016 00000100:00100000:1.0:1788748342.566892:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598016 00000100:00100000:1.0:1788748342.566915:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788748342.566921:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388598656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.567073:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388597888:0@lo:400:kworker.0 00000100:00100000:3.0:1788748342.572614:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388598144:12345-0@lo:400:kworker.0 Request processed in 5909us (6105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748342.572635:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788748342.572692:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788748342.572713:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388597760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.575430:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748342.576353:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388599040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748342.576416:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748342.576661:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788748342.576679:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388598272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.576756:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388598272:12345-0@lo:400:kworker.0 Request processed in 85us (10126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.576764:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788748342.576792:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788748342.576799:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388598784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.576828:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388598784:12345-0@lo:400:kworker.0 Request processed in 30us (10169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.576835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788748342.576864:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788748342.576871:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388598016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.576908:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388598016:12345-0@lo:400:kworker.0 Request processed in 37us (10193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.576914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788748342.576966:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388598016:0@lo:400:kworker.0 00010000:00080000:2.0:1788748342.577014:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380f100 x1875638388598272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748342.577027:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388598272:0@lo:400:kworker.0 00010000:00080000:2.0:1788748342.577039:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380d880 x1875638388598784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748342.577048:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388598784:0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.577062:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388598144:0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.577113:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388597632 00000100:00100000:2.0:1788748342.577122:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388597632 00000100:00100000:2.0:1788748342.577161:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788748342.577167:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388597632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.577676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748342.577724:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388598400:0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.577757:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748342.577777:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388598912:0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.577814:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788748342.577847:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380f480 x1875638388597504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748342.577870:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388597504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748342.577912:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598528 00000100:00100000:0.0:1788748342.577917:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598528 00000100:00100000:0.0:1788748342.577963:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598400 00000100:00100000:0.0:1788748342.577967:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598400 00000100:00100000:0.0:1788748342.577985:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388598912 00000100:00100000:0.0:1788748342.577987:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388598912 00000100:00100000:0.0:1788748342.578005:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748342.578012:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388598528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.578079:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388598528:12345-0@lo:400:kworker.0 Request processed in 67us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748342.578087:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748342.578105:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748342.578112:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388598400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.578145:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388598400:12345-0@lo:400:kworker.0 Request processed in 34us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748342.578152:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748342.578163:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748342.578170:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388598912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.578198:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388598912:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748342.578204:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788748342.578230:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748342.578234:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788748342.578256:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380c000 x1875638388598528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748342.578267:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388598528:0@lo:400:kworker.0 00010000:00080000:0.0:1788748342.578416:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380e680 x1875638388598400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748342.578420:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388597632:12345-0@lo:400:kworker.0 Request processed in 1253us (11998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748342.578427:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388598400:0@lo:400:kworker.0 00000100:00100000:2.0:1788748342.578429:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00080000:0.0:1788748342.578437:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4ef480 x1875638388598912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748342.578444:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388598912:0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.578507:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599040 00000100:00100000:0.0:1788748342.578512:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599040 00000100:00100000:0.0:1788748342.578546:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748342.578549:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388597632:0@lo:400:kworker.0 00000100:00100000:0.0:1788748342.578553:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388599040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748342.578569:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748342.578592:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388597888 00000100:00100000:2.0:1788748342.578596:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388597888 00000100:00100000:0.0:1788748342.578610:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388599040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748342.578617:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748342.578623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788748342.578637:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388597888:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788748342.578645:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f83b80 x1875638388599040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748342.578659:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388599040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748342.578676:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388597888:12345-0@lo:400:kworker.0 Request processed in 40us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748342.578682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748342.578699:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388597888:0@lo:400:kworker.0 00000100:00100000:3.0:1788748342.579640:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388597760:12345-0@lo:400:kworker.0 Request processed in 6931us (13039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748342.579653:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788748342.580738:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388597760:0@lo:400:kworker.0 00000100:00100000:1.0:1788748342.580973:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388598656:12345-0@lo:400:kworker.0 Request processed in 14049us (14427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748342.580987:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788748342.581338:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388598656:0@lo:400:kworker.0 00000100:00100000:3.0:1788748343.076545:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748343.076578:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388599168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748343.076672:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748343.077491:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599168 00000100:00100000:1.0:1788748343.077506:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599168 00000100:00100000:1.0:1788748343.077582:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788748343.077594:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388599168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748343.077633:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748343.077705:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388599168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748343.077713:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788748343.077812:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408c700 x1875638388599168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748343.077835:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388599168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748343.085603:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748343.085635:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388599296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748343.085721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748343.085799:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599296 00000100:00100000:0.0:1788748343.085809:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599296 00000100:00100000:0.0:1788748343.085869:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788748343.085879:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388599296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748343.085907:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748343.085958:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388599296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748343.085965:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788748343.086014:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f83b80 x1875638388599296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748343.086063:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388599296:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788748343.416083:0:11309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.41 00010000:00010000:0.0:1788748343.592870:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748344.612442:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748345.039736:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 22:32:24 EDT 2026 00000100:00100000:0.0:1788748345.124929:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388599424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748345.125028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748345.125078:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599424 00000100:00100000:1.0:1788748345.125090:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599424 00000100:00100000:1.0:1788748345.125156:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788748345.125167:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388599424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748345.125212:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748345.125291:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388599424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748345.125300:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748345.125389:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388599424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748345.637796:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748346.165627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748346.165674:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748346.165727:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609792 00000100:00100000:0.0:1788748346.165743:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609792 00000100:00100000:3.0:1788748346.165771:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748346.165816:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 283 00000100:00100000:3.0:1788748346.165825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610048 00000100:00100000:0.0:1788748346.165829:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2413:x1875638368609792:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748346.165849:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610048 00000100:00100000:0.0:1788748346.165935:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2413:x1875638368609792:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748346.165941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368609920 00000100:00100000:0.0:1788748346.165948:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 283 00000100:00100000:3.0:1788748346.165949:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368609920 00000100:00100000:3.0:1788748346.165989:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:3.0:1788748346.166001:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368610048:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748346.166077:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368610048:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748346.166085:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:3.0:1788748346.166105:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:3.0:1788748346.166111:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368609920:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748346.166150:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368609920:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748346.166157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00080000:3.0:1788748346.166183:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748346.166188:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788748346.663255:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748347.172937:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388599552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748347.174084:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748347.174224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599552 00000100:00100000:2.0:1788748347.174237:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599552 00000100:00100000:2.0:1788748347.177966:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788748347.177992:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388599552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748347.178057:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748347.178188:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388599552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 208us (4110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748347.178197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748347.178280:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388599552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748347.684509:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388599680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748347.684599:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.684698:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599680 00000100:00100000:0.0:1788748347.684707:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599680 00000100:00100000:0.0:1788748347.684771:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788748347.684782:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388599680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748347.684836:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748347.684889:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388599680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.684906:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788748347.684932:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748347.684970:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81180 x1875638388599680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748347.684993:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388599680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788748347.685310:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748347.686588:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388600064:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.686661:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.686696:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388600576:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.686725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.686758:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388601088:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.686780:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748347.686894:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388599936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.686934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748347.686970:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599936 00000100:00100000:2.0:1788748347.686979:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599936 00000100:00100000:2.0:1788748347.687032:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788748347.687043:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388599936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.687111:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388599936:12345-0@lo:400:kworker.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748347.687131:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788748347.688233:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600064 00000100:00100000:0.0:1788748347.688242:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600064 00000100:00100000:0.0:1788748347.688287:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600576 00000100:00100000:0.0:1788748347.688291:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600576 00000100:00100000:0.0:1788748347.688336:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601088 00000100:00100000:0.0:1788748347.688339:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601088 00000100:00100000:0.0:1788748347.688363:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788748347.688371:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388600064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.688457:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388600064:12345-0@lo:400:kworker.0 Request processed in 76us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.688465:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788748347.688482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748347.688488:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388600576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.688520:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388600576:12345-0@lo:400:kworker.0 Request processed in 32us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.688533:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748347.688545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748347.688551:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388601088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.688583:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388601088:12345-0@lo:400:kworker.0 Request processed in 32us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.688589:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748347.688635:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388599808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748347.688674:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788748347.688702:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748347.688714:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388599808 00000100:00100000:0.0:1788748347.688718:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388599808 00000100:00100000:0.0:1788748347.688752:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788748347.688759:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388599808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788748347.688777:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748347.689240:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388599936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.689250:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388600448:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.689282:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748347.689302:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388600960:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.689334:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748347.689378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600448 00000100:00100000:2.0:1788748347.689382:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600448 00000100:00100000:2.0:1788748347.689411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600960 00000100:00100000:2.0:1788748347.689414:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600960 00000100:00100000:2.0:1788748347.689434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788748347.689441:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388600448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.689491:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388600448:12345-0@lo:400:kworker.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748347.689498:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788748347.689511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788748347.689516:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388600960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.689542:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388600960:12345-0@lo:400:kworker.0 Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748347.689548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788748347.689582:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388600448:0@lo:400:kworker.0 00000100:00100000:2.0:1788748347.689591:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388600960:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.690957:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388599808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2191us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.690972:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788748347.691017:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748347.691023:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748347.691059:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4eed80 x1875638388599808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748347.691906:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388599808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748347.691924:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388600320:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.691989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.692032:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388600832:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.692077:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748347.692210:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600320 00000100:00100000:1.0:1788748347.692219:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600320 00000100:00100000:1.0:1788748347.692276:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788748347.692286:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388600320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.692359:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388600320:12345-0@lo:400:kworker.0 Request processed in 74us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748347.692366:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788748347.692508:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388600320:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.692522:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788748347.692529:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388600192:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.692557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.692581:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388600704:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.692601:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.692616:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388601216:0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.692632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748347.692657:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600192 00000100:00100000:0.0:1788748347.692661:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600192 00000100:00100000:0.0:1788748347.692687:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788748347.692693:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388600192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748347.692726:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388600192:12345-0@lo:400:kworker.0 Request processed in 33us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748347.692732:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788748347.692748:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600832 00000100:00100000:0.0:1788748347.692751:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600832 00000100:00100000:0.0:1788748347.692779:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388600704 00000100:00100000:0.0:1788748347.692781:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388600704 00000100:00100000:1.0:1788748347.692968:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601216 00000100:00100000:1.0:1788748347.692973:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601216 00000100:00100000:1.0:1788748347.692993:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748347.692999:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388600832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.693033:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388600832:12345-0@lo:400:kworker.0 Request processed in 34us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748347.693039:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748347.693049:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748347.693053:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388600704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.693074:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388600704:12345-0@lo:400:kworker.0 Request processed in 21us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748347.693152:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748347.693165:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748347.693170:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388601216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748347.693200:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388601216:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748347.693218:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748347.693980:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388600064:0@lo:400:kworker.0 00010000:00080000:1.0:1788748347.693999:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc825c3b80 x1875638388600576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748347.694011:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388600576:0@lo:400:kworker.0 00010000:00080000:1.0:1788748347.694025:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bdc00 x1875638388601088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748347.694034:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388601088:0@lo:400:kworker.0 00000100:00080000:0.0:1788748347.694934:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748347.694972:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388600192:0@lo:400:kworker.0 00010000:00080000:0.0:1788748347.694990:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bce00 x1875638388600704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748347.695000:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388600704:0@lo:400:kworker.0 00010000:00080000:0.0:1788748347.695012:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b0a680 x1875638388601216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748347.695031:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388601216:0@lo:400:kworker.0 00010000:00080000:0.0:1788748347.695047:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bc000 x1875638388600832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748347.695055:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388600832:0@lo:400:kworker.0 00000100:00100000:2.0:1788748348.196492:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748348.196635:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748348.196660:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388601472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748348.196751:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748348.196856:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601472 00000100:00100000:0.0:1788748348.196865:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601472 00000100:00100000:0.0:1788748348.196923:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748348.196933:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388601472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748348.196976:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748348.197026:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388601472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748348.197034:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788748348.197082:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb537ce00 x1875638388601472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748348.197104:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388601472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748348.197459:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388601344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748348.197506:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748348.197611:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601344 00000100:00100000:0.0:1788748348.197616:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601344 00000100:00100000:0.0:1788748348.197683:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788748348.197691:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388601344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748348.197706:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748348.197890:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388601344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748348.197902:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788748348.197967:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408fb80 x1875638388601344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748348.197983:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388601344:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788748348.709060:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748349.735339:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748350.244819:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388601600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748350.244924:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748350.245334:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601600 00000100:00100000:0.0:1788748350.245344:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601600 00000100:00100000:0.0:1788748350.245409:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788748350.245421:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388601600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748350.245487:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788748350.245550:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388601600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748350.245558:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788748350.245611:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388601600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788748350.757606:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748351.285539:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748351.285600:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748351.285650:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748351.285691:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610304 00000100:00100000:3.0:1788748351.285702:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610304 00000100:00100000:3.0:1788748351.285772:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610432 00000100:00100000:3.0:1788748351.285776:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610432 00000100:00100000:3.0:1788748351.285805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:3.0:1788748351.285833:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368610304:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748351.285929:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368610304:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 100us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748351.285938:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:3.0:1788748351.285958:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:3.0:1788748351.285964:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368610432:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748351.285991:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368610432:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748351.285998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00080000:3.0:1788748351.286017:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748351.286022:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748351.286466:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610176 00000100:00100000:1.0:1788748351.286472:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610176 00000100:00100000:1.0:1788748351.286518:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 285 00000100:00100000:1.0:1788748351.286526:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368610176:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748351.286566:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368610176:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 42us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748351.286572:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 285 00010000:00010000:0.0:1788748351.781742:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748352.303490:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748352.303519:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388601728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748352.303611:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.303692:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601728 00000100:00100000:2.0:1788748352.303701:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601728 00000100:00100000:2.0:1788748352.303752:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748352.303761:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388601728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748352.303804:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748352.303971:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388601728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 209us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.303980:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788748352.304065:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388601728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788748352.804478:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748352.805073:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388601856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748352.805170:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.807602:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601856 00000100:00100000:2.0:1788748352.807616:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601856 00000100:00100000:2.0:1788748352.807708:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748352.807721:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388601856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748352.807880:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748352.807985:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388601856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.807993:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748352.808021:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748352.808038:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388601984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748352.808204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788748352.808262:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748352.808275:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388601984 00000100:00100000:2.0:1788748352.808280:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388601984 00000100:00100000:2.0:1788748352.808357:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788748352.808365:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388601984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748352.808378:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748352.808422:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388601984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.808429:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788748352.808445:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788748352.808474:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4ece00 x1875638388601984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748352.808496:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388601984:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788748352.808534:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840baa00 x1875638388601856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748352.808548:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388601856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748352.810914:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388602112:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.811000:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.812136:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388602496:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812205:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.812256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388602368:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.812306:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748352.812312:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388602240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.812390:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388602368 00000100:00100000:2.0:1788748352.812399:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388602368 00000100:00100000:2.0:1788748352.812468:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788748352.812480:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388602368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812550:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388602368:12345-0@lo:400:kworker.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.812568:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788748352.812596:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388602496 00000100:00100000:2.0:1788748352.812601:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388602496 00000100:00100000:2.0:1788748352.812638:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388602240 00000100:00100000:2.0:1788748352.812642:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388602240 00000100:00100000:2.0:1788748352.812662:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788748352.812669:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388602496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812704:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388602496:12345-0@lo:400:kworker.0 Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.812711:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788748352.812723:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788748352.812728:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388602240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812754:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388602240:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.812839:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788748352.812898:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388602496:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812928:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388602240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.812938:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388602368:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.815915:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388602112 00000100:00100000:1.0:1788748352.815934:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388602112 00000100:00100000:1.0:1788748352.816009:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788748352.816019:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388602112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.816886:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388602112:12345-0@lo:400:kworker.0 Request processed in 864us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748352.816897:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788748352.816989:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388602112:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.817502:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748352.818543:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388602752:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.818617:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748352.818661:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748352.818668:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388602880:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.818696:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748352.818734:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388602752 00000100:00100000:1.0:1788748352.818742:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388602752 00000100:00100000:1.0:1788748352.818803:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788748352.818813:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388602752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.818873:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388602752:12345-0@lo:400:kworker.0 Request processed in 61us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748352.818881:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788748352.818909:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388602880 00000100:00100000:1.0:1788748352.818913:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388602880 00000100:00100000:1.0:1788748352.818940:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788748352.818947:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388602880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.818980:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388602880:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748352.818987:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788748352.819026:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a0000 x1875638388602880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748352.819052:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388602880:0@lo:400:kworker.0 00010000:00080000:1.0:1788748352.819067:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a3480 x1875638388602752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748352.819075:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388602752:0@lo:400:kworker.0 00000100:00080000:1.0:1788748352.819114:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748352.819119:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788748352.819131:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748352.819139:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388603008:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.819167:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748352.819196:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603008 00000100:00100000:1.0:1788748352.819200:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603008 00000100:00100000:1.0:1788748352.819231:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748352.819237:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388603008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.819272:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388603008:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748352.819278:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788748352.819295:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788748352.819311:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a1f80 x1875638388603008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748352.819341:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388603008:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.820459:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388602624:0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.820517:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748352.820557:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388602624 00000100:00100000:2.0:1788748352.820564:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388602624 00000100:00100000:2.0:1788748352.820609:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788748352.820619:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388602624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748352.820681:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388602624:12345-0@lo:400:kworker.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748352.820689:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788748352.820740:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748352.820766:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388602624:0@lo:400:kworker.0 00000100:00100000:3.0:1788748352.828273:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748352.828305:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388603136:0@lo:400:kworker.0 00000100:00100000:3.0:1788748352.828435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748352.828497:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603136 00000100:00100000:3.0:1788748352.828507:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603136 00000100:00100000:3.0:1788748352.828578:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748352.828588:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388603136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.829178:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388603264:0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.829222:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748352.829266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603264 00000100:00100000:1.0:1788748352.829271:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603264 00000100:00100000:1.0:1788748352.829342:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788748352.829350:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388603264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748352.829395:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388603264:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748352.829403:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1788748352.829467:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a2300 x1875638388603264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748352.829482:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388603264:0@lo:400:kworker.0 00000100:00100000:3.0:1788748352.829897:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388603136:12345-0@lo:400:kworker.0 Request processed in 1308us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748352.829905:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788748352.829931:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748352.829937:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748352.830396:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388603136:0@lo:400:kworker.0 00000100:00100000:1.0:1788748353.319801:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748353.319832:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388603392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748353.319923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748353.320190:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748353.320200:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388603520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748353.320229:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748353.320271:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603392 00000100:00100000:1.0:1788748353.320280:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603392 00000100:00100000:1.0:1788748353.320354:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603520 00000100:00100000:1.0:1788748353.320358:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603520 00000100:00100000:1.0:1788748353.320376:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748353.320385:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388603392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748353.320433:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748353.320484:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388603392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748353.320491:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748353.320511:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748353.320537:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388603520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748353.320548:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748353.320576:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388603520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748353.320581:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788748353.320619:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840b9f80 x1875638388603520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748353.320640:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388603520:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788748353.320673:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bbb80 x1875638388603392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748353.320684:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388603392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748353.829844:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748354.853053:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748355.373912:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748355.373936:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388603648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748355.374019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748355.374143:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603648 00000100:00100000:1.0:1788748355.374152:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603648 00000100:00100000:1.0:1788748355.374264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788748355.374275:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388603648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748355.374309:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748355.374385:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388603648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748355.374392:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788748355.374490:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388603648:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788748355.883841:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748356.407748:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748356.407814:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748356.408025:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748356.408620:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610560 00000100:00100000:3.0:1788748356.408636:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610560 00000100:00100000:1.0:1788748356.408710:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610688 00000100:00100000:1.0:1788748356.408724:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610688 00000100:00100000:3.0:1788748356.409087:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00100000:3.0:1788748356.409103:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368610560:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748356.409199:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368610560:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 101us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748356.409207:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00080000:3.0:1788748356.409413:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748356.409918:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610816 00000100:00100000:1.0:1788748356.409927:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610816 00000100:00100000:2.0:1788748356.411107:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:2.0:1788748356.411124:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368610688:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748356.411202:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368610688:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.411209:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:2.0:1788748356.411233:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:2.0:1788748356.411240:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368610816:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748356.411265:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368610816:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748356.411270:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00080000:2.0:1788748356.412413:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788748356.901053:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748357.412937:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748357.412980:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388603776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748357.413073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748357.413478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603776 00000100:00100000:2.0:1788748357.413490:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603776 00000100:00100000:2.0:1788748357.413555:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788748357.413566:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388603776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748357.413614:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748357.413682:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388603776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748357.413689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788748357.414748:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388603776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748357.924856:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748357.924885:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388603904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748357.924972:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748357.925170:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748357.925181:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388604032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748357.925210:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748357.925239:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388603904 00000100:00100000:2.0:1788748357.925248:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388603904 00000100:00100000:0.0:1788748357.925347:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388604288:0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.925390:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748357.925413:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388604800:0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.925437:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748357.925453:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388605312:0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.925472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748357.925488:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788748357.925493:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388604416:0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.925518:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748357.925536:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388604928:0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.925581:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.927923:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388604160:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928021:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748357.928083:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604032 00000100:00100000:3.0:1788748357.928094:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604032 00000100:00100000:1.0:1788748357.928157:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388604672:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928187:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.928204:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388605184:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928221:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.928245:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788748357.928251:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388604544:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928284:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.928296:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388605056:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928415:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748357.928449:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604288 00000100:00100000:1.0:1788748357.928454:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604288 00000100:00100000:1.0:1788748357.928501:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604800 00000100:00100000:1.0:1788748357.928506:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604800 00000100:00100000:1.0:1788748357.928520:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605312 00000100:00100000:1.0:1788748357.928523:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605312 00000100:00100000:1.0:1788748357.928537:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604672 00000100:00100000:1.0:1788748357.928540:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604672 00000100:00100000:1.0:1788748357.928564:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605184 00000100:00100000:1.0:1788748357.928567:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605184 00000100:00100000:1.0:1788748357.928584:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604544 00000100:00100000:1.0:1788748357.928587:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604544 00000100:00100000:1.0:1788748357.928602:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788748357.928612:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388604288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928684:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388604288:12345-0@lo:400:kworker.0 Request processed in 73us (3293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.928691:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788748357.928712:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788748357.928718:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388604800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928760:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388604800:12345-0@lo:400:kworker.0 Request processed in 43us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.928767:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788748357.928779:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788748357.928785:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388605312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928815:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388605312:12345-0@lo:400:kworker.0 Request processed in 29us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.928820:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788748357.928840:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788748357.928848:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388604672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928881:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388604672:12345-0@lo:400:kworker.0 Request processed in 34us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.928887:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788748357.928899:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788748357.928905:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388605184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928933:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388605184:12345-0@lo:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.928939:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788748357.928949:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788748357.928955:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388604544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.928990:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388604544:12345-0@lo:400:kworker.0 Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.928994:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788748357.929012:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604160 00000100:00100000:1.0:1788748357.929014:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604160 00000100:00100000:1.0:1788748357.929045:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788748357.929308:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388604160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.929370:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388604160:12345-0@lo:400:kworker.0 Request processed in 319us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.929387:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788748357.929427:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604928 00000100:00100000:1.0:1788748357.929431:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604928 00000100:00100000:1.0:1788748357.929459:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605056 00000100:00100000:1.0:1788748357.929462:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605056 00000100:00100000:1.0:1788748357.929482:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788748357.929488:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388604928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.929523:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388604928:12345-0@lo:400:kworker.0 Request processed in 35us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.929529:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788748357.929541:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748357.929547:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388605056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.929576:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388605056:12345-0@lo:400:kworker.0 Request processed in 29us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748357.929581:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748357.929632:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388604544:0@lo:400:kworker.0 00010000:00080000:1.0:1788748357.929646:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407f100 x1875638388605056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748357.929656:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388605056:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.929665:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388604160:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.929675:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388604672:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.929697:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388605184:0@lo:400:kworker.0 00010000:00080000:1.0:1788748357.929750:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407df80 x1875638388604928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748357.929761:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388604928:0@lo:400:kworker.0 00000100:00100000:1.0:1788748357.929773:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388604288:0@lo:400:kworker.0 00010000:00080000:1.0:1788748357.929788:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407ca80 x1875638388604800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748357.929797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388604800:0@lo:400:kworker.0 00010000:00080000:1.0:1788748357.929808:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8407f800 x1875638388605312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748357.929815:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388605312:0@lo:400:kworker.0 00000100:00100000:0.0:1788748357.929883:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388604416 00000100:00100000:0.0:1788748357.929890:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388604416 00000100:00100000:0.0:1788748357.929934:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788748357.929943:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388604416:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788748357.929953:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748357.929960:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748357.929963:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748357.929967:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748357.930000:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388604416:12345-0@lo:400:kworker.0 Request processed in 58us (4479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748357.930007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788748357.930030:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388604416:0@lo:400:kworker.0 00000100:00100000:3.0:1788748357.934233:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788748357.934266:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388604032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748357.934413:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748357.934557:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388604032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 309us (9344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748357.934591:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788748357.934617:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788748357.934624:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388603904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748357.934639:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788748357.934764:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840b9f80 x1875638388604032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748357.934791:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388604032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788748357.934801:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748357.934832:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388603904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 206us (9858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748357.934841:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788748357.934851:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4ef480 x1875638388603904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748357.934868:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388603904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748358.437280:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388605440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748358.437409:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748358.437634:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605440 00000100:00100000:3.0:1788748358.437644:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605440 00000100:00100000:3.0:1788748358.437704:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788748358.437724:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388605440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748358.437772:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748358.437784:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748358.437798:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388605568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748358.437836:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388605440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748358.437844:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788748358.437947:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ea00 x1875638388605440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748358.437970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388605440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748358.438023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748358.438094:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605568 00000100:00100000:3.0:1788748358.438099:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605568 00000100:00100000:3.0:1788748358.438133:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788748358.438139:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388605568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748358.438150:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748358.438189:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388605568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748358.438195:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788748358.438265:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc83b480 x1875638388605568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748358.438278:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388605568:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788748358.615957:0:11986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:32:38 (1788748358) === 00010000:00010000:3.0:1788748358.949708:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748359.043146:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.043220:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368610944 00000100:00100000:0.0:1788748359.043236:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368610944 00000100:00100000:1.0:1788748359.043366:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:1.0:1788748359.043395:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:8729:x1875638368610944:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788748359.043415:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748359.043434:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e1a059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3acd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.043463:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e1a059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3acd expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.043474:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e1a059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3acd expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.043483:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb600, rc 0) 00000100:00100000:1.0:1788748359.043540:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8729:x1875638368610944:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 153us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.043547:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:3.0:1788748359.063969:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748359.064099:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611072 00000100:00100000:2.0:1788748359.064117:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611072 00000100:00100000:2.0:1788748359.064214:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 290 00000100:00100000:2.0:1788748359.064228:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8729:x1875638368611072:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788748359.064507:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8729:x1875638368611072:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 280us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748359.064516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 290 00000100:00100000:3.0:1788748359.068982:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.069464:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611200 00000100:00100000:1.0:1788748359.069478:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611200 00000100:00100000:1.0:1788748359.069552:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:1.0:1788748359.069564:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8729:x1875638368611200:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788748359.070807:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8729:x1875638368611200:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 1234us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.070834:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:1.0:1788748359.075934:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.082470:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611328 00000100:00100000:0.0:1788748359.082494:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611328 00000100:00100000:0.0:1788748359.082673:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 292 00000100:00100000:0.0:1788748359.082687:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8733:x1875638368611328:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748359.082923:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8733:x1875638368611328:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 238us (7001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748359.082953:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 292 00000100:00100000:3.0:1788748359.112512:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.117294:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611456 00000100:00100000:1.0:1788748359.117357:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611456 00000100:00100000:1.0:1788748359.117467:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00100000:1.0:1788748359.117481:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8733:x1875638368611456:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748359.117708:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8733:x1875638368611456:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 229us (5220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.117718:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00100000:3.0:1788748359.126695:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.126955:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611584 00000100:00100000:0.0:1788748359.126970:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611584 00000100:00100000:0.0:1788748359.127074:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 294 00000100:00100000:0.0:1788748359.127086:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8733:x1875638368611584:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748359.127296:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8733:x1875638368611584:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 212us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748359.127304:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 294 00000100:00100000:3.0:1788748359.130149:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.130244:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611712 00000100:00100000:1.0:1788748359.130256:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611712 00000100:00100000:1.0:1788748359.130379:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:1.0:1788748359.130392:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:8729:x1875638368611712:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788748359.130417:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748359.130443:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e1a060 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3afe expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.130492:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e1a060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3afe expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.130507:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e1a060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3afe expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.130516:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb200, rc 0) 00000100:00100000:1.0:1788748359.130589:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+12:8729:x1875638368611712:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 199us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.130618:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:1.0:1788748359.135760:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.135883:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611840 00000100:00100000:0.0:1788748359.135896:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611840 00000100:00100000:0.0:1788748359.135963:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 296 00000100:00100000:0.0:1788748359.135974:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:8729:x1875638368611840:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788748359.136008:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788748359.136043:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788748359.136048:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788748359.136052:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788748359.136055:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788748359.136058:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788748359.139399:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:8729:x1875638368611840:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 3411us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748359.139416:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 296 00000100:00100000:3.0:1788748359.145469:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.145553:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368611968 00000100:00100000:1.0:1788748359.145568:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368611968 00000100:00100000:1.0:1788748359.145700:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:1.0:1788748359.145726:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+12:8729:x1875638368611968:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788748359.145751:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748359.145785:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b05 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.145819:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.145984:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748359.145992:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbac00, rc 0) 00000100:00100000:1.0:1788748359.146056:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8729:x1875638368611968:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 346us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.146064:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:1.0:1788748359.149910:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.150026:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612096 00000100:00100000:0.0:1788748359.150039:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612096 00000100:00100000:0.0:1788748359.150118:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:0.0:1788748359.150131:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8729:x1875638368612096:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788748359.150432:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8729:x1875638368612096:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 303us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748359.150441:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:3.0:1788748359.161988:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.162413:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612224 00000100:00100000:1.0:1788748359.162428:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612224 00000100:00100000:1.0:1788748359.162504:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:1.0:1788748359.162517:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8729:x1875638368612224:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788748359.162729:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8729:x1875638368612224:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 215us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.162746:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:1.0:1788748359.169196:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748359.169648:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612352 00000100:00100000:3.0:1788748359.169663:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612352 00000100:00100000:3.0:1788748359.169735:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 300 00000100:00100000:3.0:1788748359.169748:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8739:x1875638368612352:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748359.169966:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8739:x1875638368612352:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 219us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748359.169975:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 300 00000100:00100000:3.0:1788748359.173118:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.173232:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612480 00000100:00100000:0.0:1788748359.173244:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612480 00000100:00100000:0.0:1788748359.173310:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:0.0:1788748359.173355:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8739:x1875638368612480:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748359.173575:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:8739:x1875638368612480:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 223us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748359.173583:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:0.0:1788748359.180848:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.180899:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.181057:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612608 00000100:00100000:1.0:1788748359.181071:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612608 00000100:00100000:1.0:1788748359.181129:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612864 00000100:00100000:1.0:1788748359.181132:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612864 00000100:00100000:1.0:1788748359.183397:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788748359.183411:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2409:x1875638368612608:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788748359.183457:0:8447:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from ddb7c46a-889a-48c4-9f54-7a258d039b87@192.168.203.22@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1788748359.183522:0:8447:0:(genops.c:1384:class_connect()) connect: client ddb7c46a-889a-48c4-9f54-7a258d039b87, cookie 0x9ba0f20a02e1a06e 00000004:00100000:1.0:1788748359.183560:0:8447:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788748359.183723:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8adc83fb7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748359.183819:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2409:x1875638368612608:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 408us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.183828:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788748359.183851:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1788748359.183856:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2409:x1875638368612864:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788748359.183903:0:8447:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from ddb7c46a-889a-48c4-9f54-7a258d039b87@192.168.203.22@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1788748359.183932:0:8447:0:(genops.c:1384:class_connect()) connect: client ddb7c46a-889a-48c4-9f54-7a258d039b87, cookie 0x9ba0f20a02e1a075 00000004:00100000:1.0:1788748359.183948:0:8447:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788748359.184012:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8adc83fb4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748359.184039:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2409:x1875638368612864:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 181us (3139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.184047:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788748359.187084:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748359.187224:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748359.187365:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368613248 00000100:00100000:3.0:1788748359.187388:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368613248 00000100:00100000:3.0:1788748359.187461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368613376 00000100:00100000:3.0:1788748359.187466:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368613376 00000100:00100000:3.0:1788748359.187488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:3.0:1788748359.187571:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368613248:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748359.187675:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368613248:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 109us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748359.187684:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:0.0:1788748359.187918:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:0.0:1788748359.188010:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368613376:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748359.188052:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368613376:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 125us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748359.188059:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00080000:0.0:1788748359.188148:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748359.188154:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748359.192637:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.193054:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612736 00000100:00100000:1.0:1788748359.193146:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612736 00000100:00100000:1.0:1788748359.193249:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788748359.193262:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:0:x1875638368612736:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788748359.193312:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748359.193485:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:0:x1875638368612736:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 224us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748359.193494:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00080000:0.0:1788748359.193576:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748359.195821:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748359.195885:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368612992 00000100:00100000:3.0:1788748359.195898:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368612992 00000100:00100000:3.0:1788748359.196453:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1788748359.196466:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:0:x1875638368612992:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788748359.196515:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748359.196635:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:0:x1875638368612992:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 171us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748359.196643:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00080000:0.0:1788748359.197898:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748359.199185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748359.199431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368613120 00000100:00100000:2.0:1788748359.199444:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368613120 00000100:00100000:2.0:1788748359.199517:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1788748359.199529:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368613120:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788748359.199570:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788748359.199666:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368613120:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 139us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748359.199681:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1788748359.209029:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748359.209281:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368613504 00000100:00100000:0.0:1788748359.209294:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368613504 00000100:00100000:0.0:1788748359.209530:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1788748359.209561:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368613504:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788748359.209699:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368613504:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 141us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748359.209708:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1788748359.212150:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748359.213268:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748359.213928:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368613632 00000100:00100000:1.0:1788748359.213944:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368613632 00000100:00100000:1.0:1788748359.214042:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368613760 00000100:00100000:1.0:1788748359.214046:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368613760 00000100:00100000:3.0:1788748359.214099:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788748359.214111:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875638368613632:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788748359.214157:0:8425:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from ddb7c46a-889a-48c4-9f54-7a258d039b87@192.168.203.22@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1788748359.214200:0:8425:0:(genops.c:1384:class_connect()) connect: client ddb7c46a-889a-48c4-9f54-7a258d039b87, cookie 0x9ba0f20a02e1a07c 00002000:00100000:3.0:1788748359.214216:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ddb7c46a-889a-48c4-9f54-7a258d039b87/ffff8addbf48b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788748359.214231:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788748359.214364:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788748359.214419:0:8425:0:(import.c:65:import_set_state_nolock()) ffff8addbf489000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748359.214828:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2409:x1875638368613632:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 715us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748359.214839:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788748359.214866:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788748359.214872:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875638368613760:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788748359.214896:0:8425:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from ddb7c46a-889a-48c4-9f54-7a258d039b87@192.168.203.22@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1788748359.214919:0:8425:0:(genops.c:1384:class_connect()) connect: client ddb7c46a-889a-48c4-9f54-7a258d039b87, cookie 0x9ba0f20a02e1a083 00002000:00100000:3.0:1788748359.214926:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ddb7c46a-889a-48c4-9f54-7a258d039b87/ffff8addbf48e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788748359.214961:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788748359.215013:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788748359.215031:0:8425:0:(import.c:65:import_set_state_nolock()) ffff8addbf48d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748359.218891:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2409:x1875638368613760:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 185us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748359.218909:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1788748359.221104:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748359.221313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368613888 00000100:00100000:2.0:1788748359.221416:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368613888 00000100:00100000:2.0:1788748359.221644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1788748359.221657:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368613888:12345-192.168.203.22@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788748359.221880:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368613888:12345-192.168.203.22@tcp:900:mount.lustre.0 Request processed in 225us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748359.221891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1788748359.224059:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748359.224215:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614016 00000100:00100000:3.0:1788748359.224229:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614016 00000100:00100000:3.0:1788748359.224306:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1788748359.224445:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368614016:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788748359.225009:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788748359.225527:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:8729:x1875638368614016:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 1203us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748359.225545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00010000:00010000:3.0:1788748359.972528:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748360.486594:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748360.486617:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388605696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748360.486697:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748360.486774:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605696 00000100:00100000:1.0:1788748360.486781:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605696 00000100:00100000:1.0:1788748360.486826:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788748360.486835:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388605696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748360.486868:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748360.486913:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388605696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748360.486920:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788748360.486964:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388605696:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788748360.996716:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748362.020927:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748362.533482:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748362.533506:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388605824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748362.533577:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748362.533651:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605824 00000100:00100000:3.0:1788748362.533659:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605824 00000100:00100000:3.0:1788748362.533704:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788748362.533713:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388605824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788748362.533746:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748362.533794:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388605824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748362.533801:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788748362.533847:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388605824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748363.044581:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388605952:0@lo:400:kworker.0 00000100:00100000:3.0:1788748363.044660:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748363.044729:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388606464:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.044739:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388606208:0@lo:400:kworker.0 00000100:00100000:3.0:1788748363.044763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748363.044783:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748363.044795:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388606976:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.044812:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388606720:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.044843:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748363.044861:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388607232:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.044887:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748363.044888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748363.044905:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748363.044917:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788748363.044921:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388607488:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.044922:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606720 00000100:00100000:0.0:1788748363.044928:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388606080:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.044931:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606720 00000100:00100000:3.0:1788748363.044960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748363.044967:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748363.044987:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788748363.044989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388607232 00000100:00100000:0.0:1788748363.044992:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388606592:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.044994:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388607232 00000100:00100000:3.0:1788748363.044997:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388606336:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.045024:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606080 00000100:00100000:2.0:1788748363.045028:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606080 00000100:00100000:0.0:1788748363.045032:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748363.045047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606592 00000100:00100000:2.0:1788748363.045051:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606592 00000100:00100000:0.0:1788748363.045061:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388607104:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.045075:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788748363.045089:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388606720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045102:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748363.045138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606464 00000100:00100000:0.0:1788748363.045143:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606464 00000100:00100000:3.0:1788748363.045155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388607104 00000100:00100000:2.0:1788748363.045155:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388606720:12345-0@lo:400:kworker.0 Request processed in 69us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748363.045162:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388607104 00000100:00100000:2.0:1788748363.045166:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788748363.045179:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606208 00000100:00100000:0.0:1788748363.045184:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606208 00000100:00100000:2.0:1788748363.045191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788748363.045198:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788748363.045203:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388607232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045211:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788748363.045212:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388606080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045225:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388606464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.045245:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388607232:12345-0@lo:400:kworker.0 Request processed in 47us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748363.045259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788748363.045263:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388606080:12345-0@lo:400:kworker.0 Request processed in 54us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748363.045273:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788748363.045283:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788748363.045285:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388606464:12345-0@lo:400:kworker.0 Request processed in 61us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748363.045295:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788748363.045297:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388606592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045297:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788748363.045309:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388607104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045356:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788748363.045366:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388606208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.045373:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388606592:12345-0@lo:400:kworker.0 Request processed in 78us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748363.045382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788748363.045394:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388607104:12345-0@lo:400:kworker.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748363.045412:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388606208:12345-0@lo:400:kworker.0 Request processed in 47us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748363.045419:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788748363.045430:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388606080:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045445:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606976 00000100:00100000:2.0:1788748363.045446:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388606592:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045450:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606976 00000100:00100000:2.0:1788748363.045460:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388607104:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.045474:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388606208:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045484:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388607488 00000100:00100000:0.0:1788748363.045488:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388607488 00010000:00080000:2.0:1788748363.045491:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf487800 x1875638388606720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748363.045502:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388606720:0@lo:400:kworker.0 00000100:00100000:0.0:1788748363.045512:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788748363.045517:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf485880 x1875638388607232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748363.045524:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388606976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.045532:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388607232:0@lo:400:kworker.0 00000100:00100000:3.0:1788748363.045566:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788748363.045571:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388606976:12345-0@lo:400:kworker.0 Request processed in 48us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748363.045580:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788748363.045595:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788748363.045607:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388607488:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788748363.045614:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748363.045620:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748363.045623:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748363.045626:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748363.045642:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748363.045648:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388607488:12345-0@lo:400:kworker.0 Request processed in 44us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748363.045656:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788748363.045671:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388606848:0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.045826:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388607616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748363.045856:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748363.045898:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388605952 00000100:00100000:1.0:1788748363.045903:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388605952 00000100:00100000:0.0:1788748363.045937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748363.046961:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606336 00000100:00100000:2.0:1788748363.046966:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606336 00000100:00100000:2.0:1788748363.046996:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788748363.047004:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388606336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.047055:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388606336:12345-0@lo:400:kworker.0 Request processed in 52us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748363.047062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788748363.053059:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788748363.053089:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388605952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.053198:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388605952:12345-0@lo:400:kworker.0 Request processed in 124us (8540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748363.053206:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788748363.053256:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388607616 00000100:00100000:1.0:1788748363.053263:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388607616 00000100:00100000:1.0:1788748363.053310:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748363.053331:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388607616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748363.053363:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748363.053394:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388607616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (7537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748363.053400:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788748363.053927:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf49d500 x1875638388607616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748363.053948:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388607616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748363.053997:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748363.054008:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388607744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748363.054046:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748363.054078:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388607744 00000100:00100000:1.0:1788748363.054083:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388607744 00000100:00100000:1.0:1788748363.054881:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788748363.054891:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388607744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748363.054910:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748363.054974:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388607744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748363.054981:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788748363.055004:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788748363.055030:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc825c3480 x1875638388607744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748363.055046:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388607744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748363.059772:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388607360:0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.059836:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788748363.067145:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf485500 x1875638388606976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748363.067163:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388606976:0@lo:400:kworker.0 00010000:00080000:1.0:1788748363.067177:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf486a00 x1875638388607488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748363.067186:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388607488:0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.067196:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388605952:0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.067206:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388606464:0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.067240:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388606336:0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.072335:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388606848 00000100:00100000:2.0:1788748363.072362:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388606848 00000100:00080000:2.0:1788748363.072417:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748363.072455:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388607360 00000100:00100000:3.0:1788748363.072463:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388607360 00000100:00100000:2.0:1788748363.072470:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788748363.072481:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388606848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748363.072518:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788748363.072527:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388607360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748363.072587:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388606848:12345-0@lo:400:kworker.0 Request processed in 108us (26887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748363.072589:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388607360:12345-0@lo:400:kworker.0 Request processed in 62us (12751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748363.072600:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788748363.072617:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788748363.072648:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf487480 x1875638388606848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748363.072662:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388606848:0@lo:400:kworker.0 00010000:00080000:2.0:1788748363.072676:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf487b80 x1875638388607360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748363.072683:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388607360:0@lo:400:kworker.0 00000100:00100000:1.0:1788748363.556862:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388607872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748363.556936:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748363.557079:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388607872 00000100:00100000:2.0:1788748363.557088:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388607872 00000100:00100000:2.0:1788748363.557146:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748363.557156:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388607872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748363.557184:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748363.557251:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388607872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748363.557258:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748363.557578:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388608000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748363.557610:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788748363.558685:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533ea00 x1875638388607872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748363.558708:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388607872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748363.559959:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608000 00000100:00100000:1.0:1788748363.559970:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608000 00000100:00100000:1.0:1788748363.560084:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788748363.560108:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388608000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748363.560143:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748363.560226:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388608000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748363.560233:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788748363.560376:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c0000 x1875638388608000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748363.560397:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388608000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748364.068919:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748364.563149:0:12179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788748364.614587:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748364.614628:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748364.614648:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748364.614672:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748364.614703:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748364.614724:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748364.614748:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748364.614773:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614400 00000100:00100000:2.0:1788748364.614783:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614400 00000100:00100000:2.0:1788748364.614837:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614656 00000100:00100000:2.0:1788748364.614841:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614656 00000100:00100000:2.0:1788748364.614855:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614272 00000100:00100000:2.0:1788748364.614858:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614272 00000100:00100000:2.0:1788748364.614869:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614528 00000100:00100000:2.0:1788748364.614871:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614528 00000100:00100000:2.0:1788748364.614886:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:2.0:1788748364.614895:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368614400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748364.614965:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368614400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 71us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748364.614972:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:2.0:1788748364.614989:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:2.0:1788748364.614995:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614656:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748364.615037:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614656:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 42us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748364.615044:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:2.0:1788748364.615070:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:2.0:1788748364.615077:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368614272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748364.615101:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368614272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748364.615107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:2.0:1788748364.615119:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:2.0:1788748364.615125:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614528:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748364.615148:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614528:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748364.615154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:2.0:1788748364.615171:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614912 00000100:00100000:2.0:1788748364.615175:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614912 00000100:00100000:2.0:1788748364.615203:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614784 00000100:00100000:2.0:1788748364.615206:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614784 00000100:00100000:2.0:1788748364.615226:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1788748364.615233:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614912:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748364.615259:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614912:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748364.615266:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1788748364.615276:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:2.0:1788748364.615282:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614784:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748364.615348:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2412:x1875638368614784:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748364.615356:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00080000:2.0:1788748364.615379:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748364.615384:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748364.615386:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748364.615388:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748364.615795:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368614144 00000100:00100000:3.0:1788748364.615800:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368614144 00000100:00100000:3.0:1788748364.615850:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 303 00000100:00100000:3.0:1788748364.615858:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368614144:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748364.615893:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368614144:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748364.615899:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 303 00010000:00010000:2.0:1788748365.093015:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748365.099722:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000001:00100000:0.0:1788748365.100643:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000001:00100000:0.0:1788748365.101432:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000001:00100000:2.0:1788748365.103403:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000100:00100000:2.0:1788748365.605109:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388608128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748365.605279:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748365.605426:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608128 00000100:00100000:0.0:1788748365.605436:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608128 00000100:00100000:0.0:1788748365.605551:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788748365.605564:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388608128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748365.605610:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788748365.605682:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388608128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748365.605690:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788748365.605779:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388608128:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748366.116672:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748367.141441:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748367.652818:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748367.652849:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388608256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748367.652939:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748367.653027:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608256 00000100:00100000:2.0:1788748367.653036:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608256 00000100:00100000:2.0:1788748367.653091:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788748367.653102:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388608256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748367.653144:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748367.653197:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388608256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748367.653204:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788748367.653257:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388608256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748368.164477:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388608384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748368.164522:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388608768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.164581:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388608512:0@lo:400:kworker.0 00000100:00100000:2.0:1788748368.164621:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388608640:0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.167508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748368.167575:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388609280:0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.167751:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748368.167793:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388609792:0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.167836:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748368.167893:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608768 00000100:00100000:0.0:1788748368.167901:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608768 00000100:00100000:0.0:1788748368.167947:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788748368.167955:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388608768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.168022:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388608768:12345-0@lo:400:kworker.0 Request processed in 67us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748368.168029:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788748368.168067:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388608768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.168993:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.169037:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388608896:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.169071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.169094:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388609408:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.169134:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.169158:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388609920:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.169189:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.169211:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788748368.169218:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388609024:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.169238:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.169255:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388609536:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.169275:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.169291:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388610048:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.170026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748368.170073:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609408 00000100:00100000:3.0:1788748368.170080:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609408 00000100:00100000:3.0:1788748368.170123:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609920 00000100:00100000:3.0:1788748368.170127:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609920 00000100:00100000:3.0:1788748368.170142:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609536 00000100:00100000:3.0:1788748368.170145:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609536 00000100:00100000:3.0:1788748368.170156:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610048 00000100:00100000:3.0:1788748368.170158:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610048 00000100:00100000:3.0:1788748368.170171:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788748368.170178:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388609408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.170226:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608512 00000100:00100000:0.0:1788748368.170233:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608512 00000100:00100000:3.0:1788748368.170241:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388609408:12345-0@lo:400:kworker.0 Request processed in 62us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.170249:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788748368.170272:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788748368.170277:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788748368.170282:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388609920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.170290:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388608512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.170357:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388609920:12345-0@lo:400:kworker.0 Request processed in 78us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.170365:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788748368.170381:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388608512:12345-0@lo:400:kworker.0 Request processed in 95us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.170384:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788748368.170393:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788748368.170401:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388609536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.170436:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388609536:12345-0@lo:400:kworker.0 Request processed in 39us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.170442:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788748368.170456:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788748368.170461:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388610048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.170486:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388610048:12345-0@lo:400:kworker.0 Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.170491:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788748368.170522:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c1f80 x1875638388609536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.170535:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388609536:0@lo:400:kworker.0 00010000:00080000:3.0:1788748368.170543:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c2300 x1875638388610048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.170551:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388610048:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.170559:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388608512:0@lo:400:kworker.0 00010000:00080000:3.0:1788748368.170567:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c0a80 x1875638388609408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.170575:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388609408:0@lo:400:kworker.0 00010000:00080000:3.0:1788748368.170583:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c0e00 x1875638388609920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.170591:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388609920:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.170661:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609280 00000100:00100000:3.0:1788748368.170672:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609280 00000100:00100000:3.0:1788748368.172393:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609792 00000100:00100000:3.0:1788748368.172403:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609792 00000100:00100000:3.0:1788748368.172440:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608896 00000100:00100000:3.0:1788748368.172444:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608896 00000100:00100000:3.0:1788748368.172464:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788748368.172472:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388609280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.172551:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388609280:12345-0@lo:400:kworker.0 Request processed in 79us (4800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.172559:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788748368.172575:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788748368.172580:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388609792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.172836:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388609792:12345-0@lo:400:kworker.0 Request processed in 255us (4998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.172843:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788748368.172857:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788748368.172864:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388608896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.172900:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388608896:12345-0@lo:400:kworker.0 Request processed in 37us (3827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748368.173436:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609024 00000100:00100000:2.0:1788748368.173513:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609024 00000100:00100000:2.0:1788748368.173670:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788748368.173679:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388609024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748368.173724:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388609024:12345-0@lo:400:kworker.0 Request processed in 48us (4485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748368.173730:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788748368.173751:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748368.173756:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748368.173760:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788748368.173773:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748368.173797:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748368.173822:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388609152:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.173978:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788748368.173993:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608640 00000100:00100000:3.0:1788748368.173997:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608640 00000100:00100000:3.0:1788748368.174014:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788748368.174019:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388608640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.174053:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388608640:12345-0@lo:400:kworker.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.174059:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:3.0:1788748368.174124:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c0700 x1875638388609280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.174139:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388609280:0@lo:400:kworker.0 00010000:00080000:3.0:1788748368.174152:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c3100 x1875638388609792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.174160:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388609792:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.174195:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388609024:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.174223:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388608896:0@lo:400:kworker.0 00000100:00100000:2.0:1788748368.174851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748368.175080:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388609664:0@lo:400:kworker.0 00000100:00100000:2.0:1788748368.175180:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748368.175209:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388610176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748368.175234:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748368.175260:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609152 00000100:00100000:0.0:1788748368.175266:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609152 00000100:00100000:0.0:1788748368.175301:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388609664 00000100:00100000:0.0:1788748368.175304:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388609664 00000100:00100000:0.0:1788748368.175349:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788748368.175357:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388609152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.175400:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388609152:12345-0@lo:400:kworker.0 Request processed in 44us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748368.175407:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388608640:0@lo:400:kworker.0 00000100:00100000:0.0:1788748368.175408:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788748368.175419:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788748368.175420:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388609152:0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.175435:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388609664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748368.175488:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388609664:12345-0@lo:400:kworker.0 Request processed in 59us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748368.175495:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788748368.175520:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610176 00000100:00100000:2.0:1788748368.175524:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610176 00000100:00100000:0.0:1788748368.175530:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388609664:0@lo:400:kworker.0 00000100:00100000:2.0:1788748368.175559:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748368.175566:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388610176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748368.175587:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748368.175630:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388610176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748368.175650:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788748368.175667:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788748368.175674:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf487800 x1875638388610176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748368.175690:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388610176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748368.175993:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748368.176030:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388608384 00000100:00100000:1.0:1788748368.176034:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388608384 00000100:00100000:1.0:1788748368.176056:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788748368.176064:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388608384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748368.176077:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748368.176107:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388608384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748368.176113:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788748368.176140:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf49dc00 x1875638388608384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748368.176215:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388608384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748368.678549:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748368.678573:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388610304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748368.678637:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748368.678707:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610304 00000100:00100000:0.0:1788748368.678714:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610304 00000100:00100000:0.0:1788748368.678771:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788748368.678780:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388610304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748368.678809:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748368.678858:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388610304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748368.678872:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788748368.678928:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8412b480 x1875638388610304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748368.678948:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388610304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748368.680665:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748368.680685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388610432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748368.680747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748368.681068:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610432 00000100:00100000:1.0:1788748368.681075:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610432 00000100:00100000:1.0:1788748368.681122:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788748368.681131:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388610432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748368.681149:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748368.681213:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388610432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748368.681220:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788748368.681355:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf49dc00 x1875638388610432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748368.681803:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388610432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788748369.188534:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748369.728925:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748369.728973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748369.729046:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615040 00000100:00100000:1.0:1788748369.729057:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615040 00000100:00100000:1.0:1788748369.729107:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:1.0:1788748369.729117:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368615040:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748369.729196:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368615040:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748369.729204:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:2.0:1788748369.729421:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748369.735559:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748369.740108:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615168 00000100:00100000:3.0:1788748369.740122:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615168 00000100:00100000:3.0:1788748369.740210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615296 00000100:00100000:3.0:1788748369.740214:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615296 00000100:00100000:3.0:1788748369.740240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1788748369.740261:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368615168:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748369.740378:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368615168:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 121us (11404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748369.740401:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1788748369.740418:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:3.0:1788748369.740426:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368615296:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748369.740454:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368615296:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (11034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748369.740460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00080000:0.0:1788748369.742544:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748369.742552:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748369.742690:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615424 00000100:00100000:3.0:1788748369.742699:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615424 00000100:00100000:3.0:1788748369.742755:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:3.0:1788748369.742765:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368615424:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748369.742837:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368615424:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 73us (7285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748369.742845:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00080000:3.0:1788748369.742866:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748369.745131:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748369.745187:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748369.745219:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748369.745245:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615552 00000100:00100000:2.0:1788748369.745263:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615552 00000100:00100000:1.0:1788748369.745550:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:1.0:1788748369.745563:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368615552:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748369.745623:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368615552:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 63us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748369.745630:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:2.0:1788748369.745695:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615680 00000100:00100000:2.0:1788748369.745700:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615680 00000100:00100000:2.0:1788748369.745976:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615808 00000100:00100000:2.0:1788748369.745980:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615808 00000100:00100000:2.0:1788748369.746006:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788748369.746014:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368615680:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748369.746045:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368615680:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748369.746052:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788748369.746063:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1788748369.746068:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368615808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748369.746091:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368615808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748369.746107:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00080000:2.0:1788748369.746133:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748369.746137:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748369.746233:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788748370.213541:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748370.727233:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748370.727310:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388610560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748370.727426:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748370.728558:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610560 00000100:00100000:0.0:1788748370.728568:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610560 00000100:00100000:0.0:1788748370.728629:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788748370.728639:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388610560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748370.728676:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788748370.728740:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388610560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748370.728746:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788748370.728907:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388610560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748371.237430:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788748371.492673:0:12495:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748371.492963:0:12495:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788748372.261642:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748372.772598:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748372.772676:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388610688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748372.772742:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748372.772817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610688 00000100:00100000:1.0:1788748372.772826:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610688 00000100:00100000:1.0:1788748372.772885:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788748372.772895:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388610688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748372.772928:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748372.773175:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388610688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 280us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748372.773184:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788748372.773209:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388610688:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1788748373.111207:0:12592:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748373.111778:0:12592:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788748373.284540:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388610944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748373.284652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748373.284747:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610944 00000100:00100000:2.0:1788748373.284755:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610944 00000100:00100000:2.0:1788748373.284822:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788748373.284831:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388610944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748373.284857:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748373.284894:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388610944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748373.284901:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788748373.284920:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748373.284923:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388610816:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.284954:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.284980:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388611328:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.285023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.285042:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388611840:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.285581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.285606:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388612352:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.285685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.285716:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788748373.285723:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388611200:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.285747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.285771:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388611712:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.285791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.285808:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388612224:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.285824:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.285857:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388610816 00000100:00100000:3.0:1788748373.285863:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388610816 00000100:00100000:3.0:1788748373.285896:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788748373.285902:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388610816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.285939:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388610816:12345-0@lo:400:kworker.0 Request processed in 37us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.285945:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788748373.285972:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611328 00000100:00100000:3.0:1788748373.285976:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611328 00000100:00100000:3.0:1788748373.285998:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611712 00000100:00100000:3.0:1788748373.286000:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611712 00000100:00100000:3.0:1788748373.286022:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612224 00000100:00100000:3.0:1788748373.286025:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612224 00000100:00100000:3.0:1788748373.286039:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788748373.286057:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388611328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286155:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388611328:12345-0@lo:400:kworker.0 Request processed in 106us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.286162:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788748373.286175:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788748373.286182:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388611712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286217:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388611712:12345-0@lo:400:kworker.0 Request processed in 36us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.286222:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788748373.286233:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788748373.286238:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388612224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286261:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388612224:12345-0@lo:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.286266:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:3.0:1788748373.286293:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748373.286304:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611840 00000100:00100000:3.0:1788748373.286307:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611840 00000100:00100000:3.0:1788748373.286353:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612352 00000100:00100000:3.0:1788748373.286356:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612352 00000100:00100000:3.0:1788748373.286387:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788748373.286393:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388611840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286422:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388611840:12345-0@lo:400:kworker.0 Request processed in 30us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.286427:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788748373.286437:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788748373.286442:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388612352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286464:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388612352:12345-0@lo:400:kworker.0 Request processed in 22us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.286469:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788748373.286488:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611200 00000100:00100000:3.0:1788748373.286491:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611200 00000100:00100000:3.0:1788748373.286512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788748373.286517:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388611200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286552:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388611200:12345-0@lo:400:kworker.0 Request processed in 34us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.286557:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788748373.286592:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388611072:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.286846:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388611584:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286866:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.286879:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388612096:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.286896:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.286913:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788748373.287282:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388611456:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.287313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.287355:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388611968:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.287378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748373.287395:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388612480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748373.287433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748373.287458:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611968 00000100:00100000:3.0:1788748373.287461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611072 00000100:00100000:3.0:1788748373.287464:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611072 00000100:00100000:1.0:1788748373.287464:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611968 00000100:00100000:3.0:1788748373.287489:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611584 00000100:00100000:3.0:1788748373.287492:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611584 00000100:00100000:3.0:1788748373.287505:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612096 00000100:00100000:3.0:1788748373.287508:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612096 00000100:00100000:3.0:1788748373.287520:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788748373.287520:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788748373.287526:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388611072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748373.287526:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388611968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.287607:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612480 00000100:00100000:2.0:1788748373.287611:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612480 00000100:00100000:2.0:1788748373.287637:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788748373.287643:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388612480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748373.287657:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748373.287696:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388611968:12345-0@lo:400:kworker.0 Request processed in 170us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748373.287703:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748373.287723:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388611456 00000100:00100000:1.0:1788748373.287727:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388611456 00000100:00100000:1.0:1788748373.287749:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788748373.287755:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388611456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.289056:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388612480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1409us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748373.289081:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788748373.289797:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748373.289804:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748373.289807:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748373.289809:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788748373.289842:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380e680 x1875638388610944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748373.289862:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388610944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748373.289897:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788748373.289907:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388611584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.290207:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388611072:12345-0@lo:400:kworker.0 Request processed in 2678us (3588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.290227:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:0.0:1788748373.290230:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c7800 x1875638388611968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748373.290241:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388611968:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.290244:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788748373.290252:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388612096:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788748373.290252:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380f480 x1875638388612480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748373.290264:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388612480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748373.290289:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388611072:0@lo:400:kworker.0 00000100:00100000:3.0:1788748373.290297:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388612096:12345-0@lo:400:kworker.0 Request processed in 47us (3400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748373.290302:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788748373.290335:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388612096:0@lo:400:kworker.0 00000100:00100000:1.0:1788748373.290464:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388611456:12345-0@lo:400:kworker.0 Request processed in 2708us (3149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748373.290473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788748373.291072:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388611456:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.291187:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388611584:12345-0@lo:400:kworker.0 Request processed in 1282us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748373.291195:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788748373.291231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388611200:0@lo:400:kworker.0 00010000:00080000:2.0:1788748373.291244:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c4e00 x1875638388611712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748373.291254:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388611712:0@lo:400:kworker.0 00010000:00080000:2.0:1788748373.291263:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c5500 x1875638388612224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748373.291270:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388612224:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.291289:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388610816:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.291301:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388611328:0@lo:400:kworker.0 00010000:00080000:2.0:1788748373.291392:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c6300 x1875638388611840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748373.291411:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388611840:0@lo:400:kworker.0 00010000:00080000:2.0:1788748373.291425:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c4000 x1875638388612352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748373.291431:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388612352:0@lo:400:kworker.0 00000100:00100000:0.0:1788748373.294294:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388611584:0@lo:400:kworker.0 00000100:00100000:2.0:1788748373.796615:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748373.796638:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388612608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748373.796706:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748373.796948:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748373.796958:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388612736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748373.796986:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748373.797054:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612608 00000100:00100000:0.0:1788748373.797063:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612608 00000100:00100000:0.0:1788748373.797427:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612736 00000100:00100000:0.0:1788748373.797431:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612736 00000100:00100000:0.0:1788748373.797450:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788748373.797459:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388612608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748373.797487:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748373.797704:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388612608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 245us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748373.797712:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788748373.797730:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748373.797736:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388612736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748373.797746:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748373.797788:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388612736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748373.797795:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788748373.798653:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84129880 x1875638388612736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748373.798675:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388612736:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788748373.802412:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84128000 x1875638388612608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748373.802444:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388612608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748374.308644:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748374.839563:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748374.839606:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748374.839638:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616064 00000100:00100000:2.0:1788748374.839645:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748374.839648:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616064 00000100:00100000:3.0:1788748374.839709:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616320 00000100:00100000:2.0:1788748374.839709:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748374.839715:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616320 00000100:00100000:2.0:1788748374.839742:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748374.839751:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:3.0:1788748374.839762:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368616064:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748374.839792:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748374.839823:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748374.839909:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368616064:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748374.839918:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:2.0:1788748374.839935:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616576 00000100:00100000:3.0:1788748374.839938:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616192 00000100:00100000:2.0:1788748374.839941:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616576 00000100:00100000:3.0:1788748374.839944:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616192 00000100:00100000:3.0:1788748374.839963:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616448 00000100:00100000:3.0:1788748374.839965:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616448 00000100:00100000:3.0:1788748374.839988:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:2.0:1788748374.839991:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616704 00000100:00100000:3.0:1788748374.839997:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616320:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748374.839998:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616704 00000100:00100000:3.0:1788748374.840038:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616320:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748374.840039:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1788748374.840050:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616576:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748374.840058:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:3.0:1788748374.840076:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:2.0:1788748374.840087:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616576:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748374.840088:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368616192:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748374.840102:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1788748374.840117:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1788748374.840124:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616704:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748374.840149:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616704:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748374.840155:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1788748374.840175:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:2.0:1788748374.840183:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616448:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748374.840194:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368616192:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 109us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748374.840202:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:2.0:1788748374.840215:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368616448:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00080000:3.0:1788748374.840224:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748374.840224:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00080000:3.0:1788748374.840230:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748374.840234:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748374.840236:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748374.845131:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368615936 00000100:00100000:1.0:1788748374.845146:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368615936 00000100:00100000:1.0:1788748374.845217:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 307 00000100:00100000:1.0:1788748374.845228:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368615936:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748374.845339:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368615936:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 114us (5644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748374.845346:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 307 00000020:00000004:1.0:1788748374.917527:0:12689:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748374.917849:0:12689:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788748375.337221:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748375.846871:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748375.846902:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388612864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748375.846992:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748375.847076:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612864 00000100:00100000:1.0:1788748375.847084:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612864 00000100:00100000:1.0:1788748375.847128:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788748375.847137:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388612864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748375.847168:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748375.847213:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388612864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748375.847220:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788748375.847278:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388612864:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788748376.361145:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788748376.872560:0:12786:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748376.872817:0:12786:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788748377.387601:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748377.893677:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388612992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748377.893763:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748377.893844:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388612992 00000100:00100000:2.0:1788748377.893863:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388612992 00000100:00100000:2.0:1788748377.893907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788748377.893916:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add884e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388612992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748377.893947:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748377.893991:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add884e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388612992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748377.894007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788748377.894304:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388612992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748378.405596:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388613120:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.405670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.405735:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388613632:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.405805:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.405830:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388614144:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.405866:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.405891:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388614656:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.405918:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.405960:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788748378.405968:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388613504:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406001:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406026:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388614016:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406059:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406080:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388614528:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406102:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406133:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388613248:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406159:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406178:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388613760:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406358:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406391:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388614272:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406413:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406433:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788748378.406439:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388613376:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406460:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406481:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388613888:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406501:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406517:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388614400:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.406703:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388613120 00000100:00100000:1.0:1788748378.406710:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388613120 00000100:00100000:1.0:1788748378.406757:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788748378.406767:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388613120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.406819:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388613120:12345-0@lo:400:kworker.0 Request processed in 54us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.406826:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788748378.406859:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388613632 00000100:00100000:1.0:1788748378.406863:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388613632 00000100:00100000:1.0:1788748378.406897:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388613376 00000100:00100000:1.0:1788748378.406900:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388613376 00000100:00100000:1.0:1788748378.406916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788748378.406923:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388613632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.407079:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388613632:12345-0@lo:400:kworker.0 Request processed in 156us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.407086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788748378.407100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788748378.407106:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388613376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.407140:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388613376:12345-0@lo:400:kworker.0 Request processed in 34us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.407146:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788748378.407165:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614144 00000100:00100000:1.0:1788748378.407169:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614144 00000100:00100000:1.0:1788748378.407293:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614656 00000100:00100000:1.0:1788748378.407298:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614656 00000100:00100000:1.0:1788748378.407312:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614016 00000100:00100000:1.0:1788748378.407332:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614016 00000100:00100000:1.0:1788748378.407346:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614528 00000100:00100000:1.0:1788748378.407348:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614528 00000100:00100000:1.0:1788748378.407362:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788748378.407368:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388614144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.407665:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388614144:12345-0@lo:400:kworker.0 Request processed in 296us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.407671:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788748378.407686:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788748378.407692:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388614656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.407717:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388614656:12345-0@lo:400:kworker.0 Request processed in 27us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.407729:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788748378.407742:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788748378.407749:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388614016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.407780:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388614016:12345-0@lo:400:kworker.0 Request processed in 33us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.407786:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788748378.407798:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788748378.407804:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388614528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.407833:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388614528:12345-0@lo:400:kworker.0 Request processed in 30us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.407839:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:3.0:1788748378.408514:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748378.408633:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388613504 00000100:00100000:1.0:1788748378.408639:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388613504 00000100:00100000:1.0:1788748378.408662:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388613248 00000100:00100000:1.0:1788748378.408665:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388613248 00000100:00100000:1.0:1788748378.408675:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388613760 00000100:00100000:1.0:1788748378.408677:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388613760 00000100:00100000:1.0:1788748378.408687:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614272 00000100:00100000:1.0:1788748378.408690:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614272 00000100:00100000:1.0:1788748378.408698:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388613888 00000100:00100000:1.0:1788748378.408700:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388613888 00000100:00100000:1.0:1788748378.408711:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614400 00000100:00100000:1.0:1788748378.408713:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614400 00000100:00100000:1.0:1788748378.408726:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788748378.408733:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388613504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.408781:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388613504:12345-0@lo:400:kworker.0 Request processed in 49us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.408788:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788748378.408812:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788748378.408818:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388613248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.408851:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388613248:12345-0@lo:400:kworker.0 Request processed in 33us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.409655:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788748378.409674:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748378.409683:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388613760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.409732:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388613760:12345-0@lo:400:kworker.0 Request processed in 52us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.409738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748378.409751:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788748378.409759:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388614272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.409789:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388614272:12345-0@lo:400:kworker.0 Request processed in 32us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.409795:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788748378.409806:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788748378.409814:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388613888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.409844:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388613888:12345-0@lo:400:kworker.0 Request processed in 32us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.409850:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788748378.410163:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788748378.410171:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388614400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.410206:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388614400:12345-0@lo:400:kworker.0 Request processed in 36us (3649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748378.410212:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788748378.410292:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748378.410296:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748378.410299:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748378.410301:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748378.410341:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388614912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748378.410388:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.410431:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748378.410439:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388614784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748378.410540:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748378.410765:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388613376:0@lo:400:kworker.0 00010000:00080000:1.0:1788748378.410784:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf49c000 x1875638388613888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748378.410796:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388613888:0@lo:400:kworker.0 00010000:00080000:1.0:1788748378.410811:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4ef100 x1875638388614400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748378.411056:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388614400:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.411073:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388613248:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.411083:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388613760:0@lo:400:kworker.0 00000100:00100000:3.0:1788748378.411084:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614912 00000100:00100000:3.0:1788748378.411090:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614912 00000100:00100000:1.0:1788748378.411092:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388614272:0@lo:400:kworker.0 00000100:00100000:3.0:1788748378.411118:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388614784 00000100:00100000:3.0:1788748378.411121:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388614784 00000100:00100000:3.0:1788748378.411133:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748378.411157:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb55b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388614912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748378.411178:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748378.411230:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb55b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388614912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748378.411235:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788748378.411312:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788748378.411342:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388614784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748378.411352:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788748378.411365:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84266d80 x1875638388614912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748378.411381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388613504:0@lo:400:kworker.0 00000100:00100000:1.0:1788748378.411383:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388614912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748378.417778:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388614784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6428us (7228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748378.417793:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788748378.417872:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84266680 x1875638388614784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748378.417896:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388614784:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788748378.418047:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf49e680 x1875638388614016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748378.418060:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388614016:0@lo:400:kworker.0 00010000:00080000:0.0:1788748378.418073:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4ef800 x1875638388614528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748378.418093:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388614528:0@lo:400:kworker.0 00000100:00100000:0.0:1788748378.418106:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388613120:0@lo:400:kworker.0 00000100:00100000:0.0:1788748378.418118:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388613632:0@lo:400:kworker.0 00010000:00080000:0.0:1788748378.418129:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf49c700 x1875638388614144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748378.418137:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388614144:0@lo:400:kworker.0 00010000:00080000:0.0:1788748378.418148:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4ef480 x1875638388614656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748378.418156:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388614656:0@lo:400:kworker.0 00000020:00000004:0.0:1788748378.802985:0:12884:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748378.803202:0:12884:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788748378.929134:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388615040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748378.929213:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748378.931683:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388615168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748378.931757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748378.931837:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615040 00000100:00100000:2.0:1788748378.931844:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615040 00000100:00100000:2.0:1788748378.931878:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615168 00000100:00100000:2.0:1788748378.931882:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615168 00000100:00100000:2.0:1788748378.931898:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788748378.931907:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388615040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748378.931946:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748378.941256:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388615040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9327us (12020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748378.941274:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788748378.944014:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8412aa00 x1875638388615040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748378.944042:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388615040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748378.946728:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788748378.946749:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388615168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748378.946911:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748378.947001:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388615168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 260us (15244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748378.947009:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788748378.947070:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842d4a80 x1875638388615168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748378.947091:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388615168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788748379.428509:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748379.957779:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748379.957822:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748379.957848:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748379.957898:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748379.958090:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616832 00000100:00100000:1.0:1788748379.958098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617088 00000100:00100000:1.0:1788748379.958108:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617088 00000100:00100000:0.0:1788748379.958108:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616832 00000100:00100000:0.0:1788748379.958165:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 309 00000100:00100000:1.0:1788748379.958166:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368616960 00000100:00100000:1.0:1788748379.958171:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368616960 00000100:00100000:0.0:1788748379.958187:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368616832:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748379.958192:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617216 00000100:00100000:1.0:1788748379.958195:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617216 00000100:00100000:1.0:1788748379.958211:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:1.0:1788748379.958219:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368617088:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748379.958297:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368617088:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748379.958307:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:0.0:1788748379.958313:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368616832:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 126us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748379.958355:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 309 00000100:00100000:1.0:1788748379.958359:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:1.0:1788748379.958370:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368616960:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748379.958400:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368616960:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748379.958407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:0.0:1788748379.958421:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:0.0:1788748379.958431:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368617216:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748379.958462:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368617216:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748379.958479:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00080000:3.0:1788748379.958530:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748379.958534:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748379.961749:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748379.961795:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748379.961834:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748379.961921:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617472 00000100:00100000:3.0:1788748379.961939:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617472 00000100:00100000:0.0:1788748379.961947:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617600 00000100:00100000:0.0:1788748379.961954:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617600 00000100:00100000:0.0:1788748379.962011:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:0.0:1788748379.962022:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2409:x1875638368617600:12345-192.168.203.22@tcp:9:kworker.0 00000100:00100000:1.0:1788748379.962033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617344 00000100:00100000:1.0:1788748379.962036:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617344 00000020:00000080:0.0:1788748379.962052:0:8424:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e1a083 00000100:00080000:0.0:1788748379.962061:0:8424:0:(import.c:65:import_set_state_nolock()) ffff8addbf48d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788748379.962084:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:1.0:1788748379.962090:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368617344:12345-192.168.203.22@tcp:400:kworker.0 00000001:00000004:0.0:1788748379.962102:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788748379.962152:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368617344:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 61us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748379.962171:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 160 00010000:00010000:1.0:1788748379.962215:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748379.962221:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+2:2409:x1875638368617600:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 202us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748379.962227:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:0.0:1788748379.962255:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1788748379.962262:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2409:x1875638368617472:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:0.0:1788748379.962273:0:8424:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e1a07c 00000100:00080000:0.0:1788748379.962280:0:8424:0:(import.c:65:import_set_state_nolock()) ffff8addbf489000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748379.962304:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1788748379.962350:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748379.962414:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+2:2409:x1875638368617472:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 152us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748379.962420:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00080000:2.0:1788748379.962490:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748379.962495:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748379.962497:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788748380.454561:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748380.964676:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388615296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748380.964758:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748380.965137:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615296 00000100:00100000:0.0:1788748380.965146:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615296 00000100:00100000:0.0:1788748380.965237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748380.965247:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388615296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748380.965280:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788748380.965357:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388615296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748380.965374:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788748380.965439:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388615296:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788748381.476552:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748382.089153:0:13028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788748382.503494:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748383.018001:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388615424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748383.018069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748383.024733:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615424 00000100:00100000:0.0:1788748383.024746:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615424 00000100:00100000:0.0:1788748383.024798:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748383.024807:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388615424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748383.024842:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788748383.024930:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388615424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (6862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.024945:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788748383.037405:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388615424:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788748383.524770:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748383.524881:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748383.524912:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388615552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748383.524976:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748383.525126:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615552 00000100:00100000:2.0:1788748383.525135:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615552 00000100:00100000:2.0:1788748383.525198:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788748383.525222:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388615552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748383.525253:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748383.525298:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388615552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748383.525306:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788748383.525651:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748383.525679:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84129c00 x1875638388615552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748383.525698:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388615552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748383.526092:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388615680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748383.526128:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748383.526160:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615680 00000100:00100000:0.0:1788748383.526165:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615680 00000100:00100000:0.0:1788748383.526197:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748383.526203:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388615680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748383.526228:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748383.526260:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388615680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.526280:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788748383.526299:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748383.526339:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84129c00 x1875638388615680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748383.526352:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388615680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748383.527575:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388616064:0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.527621:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748383.527644:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388616576:0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.527663:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748383.527681:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788748383.527685:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388616192:0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.527704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748383.527717:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388616704:0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.527731:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748383.527753:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616064 00000100:00100000:0.0:1788748383.527757:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616064 00000100:00100000:0.0:1788748383.527787:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788748383.527794:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388616064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.527831:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388616064:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.527838:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788748383.527856:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616576 00000100:00100000:0.0:1788748383.527859:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616576 00000100:00100000:0.0:1788748383.527882:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616704 00000100:00100000:0.0:1788748383.527884:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616704 00000100:00100000:0.0:1788748383.527923:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788748383.527929:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388616576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.527956:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388616576:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.527961:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788748383.527971:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788748383.527976:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388616704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.527994:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388616704:12345-0@lo:400:kworker.0 Request processed in 19us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.527999:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788748383.528013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616192 00000100:00100000:0.0:1788748383.528016:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616192 00000100:00100000:0.0:1788748383.528035:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788748383.528040:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388616192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.528063:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388616192:12345-0@lo:400:kworker.0 Request processed in 23us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.528068:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788748383.528093:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748383.528112:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388616192:0@lo:400:kworker.0 00010000:00080000:0.0:1788748383.528122:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84128e00 x1875638388616704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748383.528131:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388616704:0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.528138:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388616064:0@lo:400:kworker.0 00010000:00080000:0.0:1788748383.528145:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8412b100 x1875638388616576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748383.528165:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388616576:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528303:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388615808:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528354:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.528386:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388616320:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528404:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.528419:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388616832:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.528448:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788748383.528453:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388615936:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528468:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.528480:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388616448:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528495:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.528504:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388616960:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528518:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748383.528537:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616320 00000100:00100000:3.0:1788748383.528540:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616320 00000100:00100000:3.0:1788748383.528560:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616832 00000100:00100000:3.0:1788748383.528563:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616832 00000100:00100000:3.0:1788748383.528575:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615936 00000100:00100000:3.0:1788748383.528577:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615936 00000100:00100000:3.0:1788748383.528587:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616448 00000100:00100000:3.0:1788748383.528589:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616448 00000100:00100000:3.0:1788748383.528599:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388616960 00000100:00100000:3.0:1788748383.528607:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388616960 00000100:00100000:3.0:1788748383.528626:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788748383.528632:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388616320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528668:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388616320:12345-0@lo:400:kworker.0 Request processed in 37us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.528674:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788748383.528686:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788748383.528691:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388616832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528721:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388616832:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.528727:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788748383.528737:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788748383.528744:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388615936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528768:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388615936:12345-0@lo:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.528773:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788748383.528782:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788748383.528787:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388616448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528810:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388616448:12345-0@lo:400:kworker.0 Request processed in 23us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.528816:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788748383.528826:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788748383.528831:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388616960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.528855:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388616960:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748383.528870:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788748383.528972:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388615936:0@lo:400:kworker.0 00010000:00080000:3.0:1788748383.528982:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84128380 x1875638388616448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748383.528990:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388616448:0@lo:400:kworker.0 00010000:00080000:3.0:1788748383.528998:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8412aa00 x1875638388616960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748383.529005:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388616960:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.529013:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388616320:0@lo:400:kworker.0 00000100:00100000:3.0:1788748383.529020:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388616832:0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.529097:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388615808 00000100:00100000:0.0:1788748383.529102:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388615808 00000100:00100000:0.0:1788748383.529136:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788748383.529143:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388615808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748383.529179:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388615808:12345-0@lo:400:kworker.0 Request processed in 36us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748383.529185:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1788748383.529224:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748383.529227:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748383.529246:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388615808:0@lo:400:kworker.0 00000100:00100000:0.0:1788748384.036559:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748384.036589:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388617088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748384.036677:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748384.036767:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388617088 00000100:00100000:0.0:1788748384.036776:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388617088 00000100:00100000:0.0:1788748384.036833:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748384.036843:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388617088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748384.036881:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748384.036929:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388617088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748384.036936:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788748384.036988:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84129c00 x1875638388617088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748384.037010:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388617088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748384.042439:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388617216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748384.042530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748384.042662:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388617216 00000100:00100000:3.0:1788748384.042672:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388617216 00000100:00100000:3.0:1788748384.042736:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788748384.042747:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388617216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748384.042777:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748384.042833:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388617216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748384.042840:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788748384.045269:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842d5880 x1875638388617216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748384.045306:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388617216:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788748384.553478:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748385.080100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748385.080143:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748385.080162:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748385.080176:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748385.080207:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748385.080758:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617728 00000100:00100000:3.0:1788748385.080768:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617728 00000100:00100000:3.0:1788748385.080824:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 311 00000100:00100000:3.0:1788748385.080835:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368617728:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748385.080925:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368617728:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 92us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.080942:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 311 00000100:00100000:3.0:1788748385.080976:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617984 00000100:00100000:3.0:1788748385.080980:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617984 00000100:00100000:3.0:1788748385.081012:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368618240 00000100:00100000:3.0:1788748385.081015:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368618240 00000100:00100000:3.0:1788748385.081028:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368617856 00000100:00100000:3.0:1788748385.081031:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368617856 00000100:00100000:3.0:1788748385.081041:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368618112 00000100:00100000:3.0:1788748385.081044:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368618112 00000100:00100000:3.0:1788748385.081057:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:3.0:1788748385.081063:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368617984:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748385.081093:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368617984:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.081099:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:3.0:1788748385.081112:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1788748385.081117:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368618240:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748385.081137:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368618240:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.081142:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1788748385.081152:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:3.0:1788748385.081157:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368617856:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748385.081178:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368617856:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 21us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.081183:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:3.0:1788748385.081204:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:3.0:1788748385.081219:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368618112:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748385.081243:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368618112:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.081248:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00080000:3.0:1788748385.081421:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748385.081425:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1788748385.421725:0:13176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef259cad0 20000000:00000080:3.0:1788748385.421742:0:13176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8addb6af7c00 uarg=0000000000000000 20000000:01000000:3.0:1788748385.421783:0:13176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788748385.421789:0:13176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788748385.421794:0:13176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788748385.422235:0:13177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788748385.422669:0:13176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788748385.428983:0:13176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788748385.429012:0:13176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429033:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429042:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429050:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429057:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429068:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429094:0:13176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429103:0:13176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429146:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429164:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 12 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.429179:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617344:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748385.429395:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429405:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 12 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.429414:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617472:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748385.429445:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429454:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 23 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.429464:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617600:0@lo:104: 00000100:00100000:3.0:1788748385.429506:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748385.429554:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429562:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 23 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.429583:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617728:0@lo:104: 00000100:00100000:3.0:1788748385.429607:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748385.429632:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429640:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 23 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.429648:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617856:0@lo:104: 00000100:00100000:3.0:1788748385.429668:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748385.429683:0:13176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.429691:0:13176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 23 pid: 6502 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.429699:0:13176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617984:0@lo:104: 00000100:00100000:3.0:1788748385.429717:0:13176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748385.429727:0:13176:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748385.429867:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388617600 00000100:00100000:1.0:1788748385.429875:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388617600 00000100:00100000:1.0:1788748385.429923:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388617728 00000100:00100000:1.0:1788748385.429926:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388617728 00000100:00100000:1.0:1788748385.429938:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388617856 00000100:00100000:1.0:1788748385.429940:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388617856 00000100:00100000:1.0:1788748385.429950:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388617984 00000100:00100000:1.0:1788748385.429952:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388617984 00000100:00100000:1.0:1788748385.429965:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748385.429973:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:13176:x1875638388617600:12345-0@lo:104: 00010000:00010000:1.0:1788748385.429985:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430046:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748385.430052:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:13176:x1875638388617600:12345-0@lo:104: Request processed in 80us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.430059:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748385.430084:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748385.430091:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:13176:x1875638388617728:12345-0@lo:104: 00010000:00010000:1.0:1788748385.430098:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430132:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748385.430137:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:13176:x1875638388617728:12345-0@lo:104: Request processed in 48us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.430143:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748385.430155:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748385.430161:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:13176:x1875638388617856:12345-0@lo:104: 00010000:00010000:1.0:1788748385.430183:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430227:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788748385.430232:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:13176:x1875638388617856:12345-0@lo:104: Request processed in 73us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.430238:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748385.430250:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788748385.430256:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:13176:x1875638388617984:12345-0@lo:104: 00010000:00010000:1.0:1788748385.430263:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430288:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788748385.430293:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:13176:x1875638388617984:12345-0@lo:104: Request processed in 38us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.430298:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788748385.430341:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788748385.430348:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430355:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748385.430360:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430368:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748385.430375:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748385.430380:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748385.430408:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430414:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748385.430432:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430438:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a044 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a04b expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430452:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748385.430454:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430460:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748385.430463:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430474:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748385.430480:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748385.430485:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748385.430498:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430503:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748385.430508:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430514:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1a036 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a03d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430521:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748385.430524:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430528:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f7800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748385.430530:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430537:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748385.430543:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748385.430554:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748385.430577:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430583:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748385.430599:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430605:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f7800/0x9ba0f20a02e1a028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a02f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430617:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748385.430619:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430625:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbbe00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748385.430628:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430634:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748385.430641:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748385.430646:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748385.430656:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430662:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748385.430674:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430681:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addb3bbbe00/0x9ba0f20a02e1a01a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a021 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.430692:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748385.430695:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748385.430696:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748385.430703:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748385.430917:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748385.430935:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388618368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748385.430972:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748385.430996:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748385.431002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388618496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748385.431020:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748385.431045:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388618368 00000100:00100000:1.0:1788748385.431049:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388618368 00010000:00010000:1.0:1788748385.431070:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 24 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748385.431089:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388618496 00000100:00100000:1.0:1788748385.431091:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388618496 00010000:00010000:1.0:1788748385.431101:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 25 pid: 6502 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748385.431118:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788748385.431125:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3637:x1875638388618368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748385.431136:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748385.431140:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 25 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.431155:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 25 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.431170:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748385.431213:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3637:x1875638388618368:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.431220:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788748385.431233:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748385.431239:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388618496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748385.431246:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748385.431250:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 24 pid: 6502 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.431257:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 24 pid: 6502 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748385.431266:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748385.431286:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388618496:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748385.431291:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748385.431349:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388618496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748385.431358:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388618368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748385.431537:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388618112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748385.431577:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748385.431597:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748385.431602:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388618240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748385.431622:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748385.431652:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388618112 00000100:00100000:0.0:1788748385.431656:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388618112 00010000:00010000:0.0:1788748385.431672:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 24 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.431689:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388618240 00000100:00100000:0.0:1788748385.431692:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388618240 00010000:00010000:0.0:1788748385.431703:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 25 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.431715:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748385.431728:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3635:x1875638388618112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.431736:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748385.431740:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 25 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.431747:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 25 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.431757:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.431782:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3635:x1875638388618112:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.431788:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748385.431801:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788748385.431807:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388618240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.431813:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748385.431817:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 24 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.431825:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 24 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.431834:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748385.431855:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388618240:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.431860:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788748385.431885:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388618240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748385.431892:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388618112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748385.432024:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940200/0x9ba0f20a02e1a04b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a044 expref: 23 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.432036:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617600:0@lo:104: 00010000:00010000:3.0:1788748385.432045:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1a03d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a036 expref: 22 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.432062:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617728:0@lo:104: 00010000:00010000:3.0:1788748385.432074:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6e00/0x9ba0f20a02e1a02f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a028 expref: 21 pid: 6504 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.432083:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617856:0@lo:104: 00010000:00010000:3.0:1788748385.432091:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1a021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a01a expref: 20 pid: 6502 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748385.432098:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617984:0@lo:104: 00000100:00100000:3.0:1788748385.435245:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617344:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748385.440967:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748385.441208:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748385.441236:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368618368 00000100:00100000:0.0:1788748385.441268:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368618368 00010000:00010000:0.0:1788748385.441312:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 13 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.441375:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368618496 00000100:00100000:0.0:1788748385.441378:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368618496 00010000:00010000:0.0:1788748385.441392:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 14 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748385.441414:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1788748385.441423:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+14:2410:x1875638368618368:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748385.441439:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748385.441445:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 14 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.441457:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 14 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.441475:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1a067 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b05 expref: 14 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748385.441490:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748385.441532:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1788748385.441550:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368618496:12345-192.168.203.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788748385.441558:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368618368:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 130us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748385.441570:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00010000:00010000:3.0:1788748385.441573:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748385.441585:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 12 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441615:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 12 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441638:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441648:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441697:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441704:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441711:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441719:0:9515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441727:0:9515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748385.441732:0:9515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441742:0:9515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441754:0:9515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748385.441766:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748385.441821:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09ef6cf0-4626-4079-99a4-603102db0d3e+12:2410:x1875638368618496:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 279us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748385.441829:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00010000:00010000:2.0:1788748385.443956:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6800/0x9ba0f20a02e1a052 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ac6 expref: 11 pid: 6503 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748385.444008:0:13176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13176:1875638388617472:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748385.444061:0:13176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.444074:0:13176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.444080:0:13176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.444087:0:13176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1a08a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748385.575423:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748386.084506:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748386.084530:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388618624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748386.084601:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.084758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388618624 00000100:00100000:3.0:1788748386.084767:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388618624 00000100:00100000:3.0:1788748386.084831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788748386.084841:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388618624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788748386.084891:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788748386.084944:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388618624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.084952:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788748386.085000:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388618624:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788748386.087139:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000020:00000080:0.0:1788748386.087148:0:9505:0:(genops.c:885:class_export_put()) final put ffff8addbf48e800/ddb7c46a-889a-48c4-9f54-7a258d039b87 00000020:00000080:2.0:1788748386.087342:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf48e800/ddb7c46a-889a-48c4-9f54-7a258d039b87 for lustre-OST0001 00000020:00000080:2.0:1788748386.087388:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf48d000 for lustre-OST0001 00000001:00100000:2.0:1788748386.088236:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000020:00000080:2.0:1788748386.088241:0:8419:0:(genops.c:885:class_export_put()) final put ffff8addbf48b000/ddb7c46a-889a-48c4-9f54-7a258d039b87 00000020:00000080:3.0:1788748386.088352:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf48b000/ddb7c46a-889a-48c4-9f54-7a258d039b87 for lustre-OST0000 00000020:00000080:3.0:1788748386.088390:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf489000 for lustre-OST0000 00010000:00010000:3.0:1788748386.596675:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788748386.920753:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748386.920764:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc838be800 from 7 10000000:01000000:3.0:1788748386.920771:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748386.920830:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.920844:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.920858:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.920898:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388618752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.920981:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.921041:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.921071:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388618752 00000100:00100000:3.0:1788748386.921080:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388618752 00000100:00100000:3.0:1788748386.921134:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788748386.921144:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388618752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748386.921163:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748386.921195:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a091 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.921236:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.921250:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.921261:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77a00, rc 0) 00000100:00100000:3.0:1788748386.921308:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388618752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.921336:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788748386.921938:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388618752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748386.921961:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.921971:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.922056:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388618880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.922100:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.922131:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748386.923527:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388618880 00000100:00100000:1.0:1788748386.923549:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388618880 00000100:00100000:1.0:1788748386.923621:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788748386.923631:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388618880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748386.924107:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388618880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 476us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.924117:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788748386.924454:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388618880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.924517:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.924572:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.924627:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748386.925263:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619008 00000100:00100000:1.0:1788748386.925274:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619008 00000100:00100000:1.0:1788748386.925347:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788748386.925358:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388619008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748386.925635:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388619008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.925643:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788748386.926107:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788748386.928010:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788748386.933365:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788748386.933424:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748386.933439:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.933455:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748386.933468:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748386.933471:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8addb53d9000 from 7 10000000:01000000:3.0:1788748386.933474:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748386.933524:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.933533:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.933546:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.933575:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.933672:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.934036:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748386.934424:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619136 00000100:00100000:1.0:1788748386.934435:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619136 00000100:00100000:1.0:1788748386.934508:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788748386.934519:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388619136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748386.934538:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748386.934555:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a09f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.934586:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.934608:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748386.934636:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68c00, rc 0) 00000100:00100000:1.0:1788748386.934704:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388619136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748386.934721:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788748386.935284:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748386.935308:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748386.935343:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748386.935626:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748386.935671:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748386.935744:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5378e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.935857:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619264 00000100:00100000:3.0:1788748386.935864:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619264 00000100:00100000:3.0:1788748386.935913:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788748386.935922:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388619264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.936080:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388619264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.936095:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788748386.936433:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748386.936472:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748386.936519:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748386.936542:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5378e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.936905:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619392 00000100:00100000:3.0:1788748386.936911:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619392 00000100:00100000:3.0:1788748386.936949:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788748386.936957:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388619392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.937052:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388619392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.937060:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788748386.937416:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788748386.944558:0:13233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788748386.945849:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788748386.945899:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748386.945915:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.945932:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748386.945945:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748386.945949:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add8f106000 from 7 10000000:01000000:3.0:1788748386.945953:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748386.946006:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.946015:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.946029:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.946061:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.946166:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.946244:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.946272:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619520 00000100:00100000:3.0:1788748386.946282:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619520 00000100:00100000:3.0:1788748386.946368:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788748386.946379:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388619520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748386.946407:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748386.946422:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a0ad expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.946452:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.946464:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.946474:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77400, rc 0) 00000100:00100000:3.0:1788748386.946517:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388619520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.946524:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788748386.946578:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748386.946606:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.946617:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.946679:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.946711:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.946725:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.946748:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619648 00000100:00100000:3.0:1788748386.946751:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619648 00000100:00100000:3.0:1788748386.946774:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788748386.946780:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388619648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.946897:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388619648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.946906:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788748386.946936:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.946961:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.947004:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.947016:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.947026:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619776 00000100:00100000:3.0:1788748386.947030:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619776 00000100:00100000:3.0:1788748386.947047:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788748386.947052:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388619776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.947119:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388619776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.947125:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788748386.947157:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788748386.947916:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788748386.947982:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788748386.948000:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748386.948009:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.948031:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748386.948043:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748386.948045:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adda7357000 from 7 10000000:01000000:3.0:1788748386.948048:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748386.948075:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.948083:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.948093:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.948110:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.948153:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.948171:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.948201:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388619904 00000100:00100000:3.0:1788748386.948206:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388619904 00000100:00100000:3.0:1788748386.948235:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788748386.948243:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388619904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748386.948253:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748386.948263:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a0bb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.948286:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.948308:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.948341:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77e00, rc 0) 00000100:00100000:3.0:1788748386.948378:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388619904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.948384:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788748386.948419:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388619904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748386.948430:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748386.948439:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748386.948485:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388620032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.948508:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.948521:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.948531:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620032 00000100:00100000:3.0:1788748386.948534:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620032 00000100:00100000:3.0:1788748386.948555:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788748386.948560:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388620032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.948648:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388620032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.948654:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788748386.948679:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388620032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.948713:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388620160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.948748:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748386.948761:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788748386.948771:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620160 00000100:00100000:3.0:1788748386.948774:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620160 00000100:00100000:3.0:1788748386.948792:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788748386.948798:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388620160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748386.948867:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388620160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748386.948875:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788748386.948911:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388620160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788748386.958121:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788748386.958932:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788748386.958979:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748386.958995:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748386.959011:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748387.318942:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748387.319357:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368618624 00000100:00100000:3.0:1788748387.319372:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368618624 00000100:00100000:3.0:1788748387.319451:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 324 00000100:00100000:3.0:1788748387.319464:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:6183:x1875638368618624:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748387.319487:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748387.319510:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b36 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.319548:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.319562:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.319572:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76c00, rc 0) 00000100:00100000:3.0:1788748387.319902:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368618624:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 439us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748387.319911:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 324 00000100:00100000:0.0:1788748387.331713:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748387.332068:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368618752 00000100:00100000:1.0:1788748387.332081:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368618752 00000100:00100000:1.0:1788748387.332195:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 325 00000100:00100000:1.0:1788748387.332209:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368618752:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748387.335247:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368618752:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 3025us (3532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748387.335267:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 325 00000100:00100000:3.0:1788748387.339972:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748387.343559:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368618880 00000100:00100000:0.0:1788748387.343578:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368618880 00000100:00100000:0.0:1788748387.343653:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 326 00000100:00100000:0.0:1788748387.343665:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368618880:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748387.348189:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368618880:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 4500us (8205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748387.348207:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 326 00000100:00100000:3.0:1788748387.376505:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748387.376663:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619008 00000100:00100000:3.0:1788748387.376675:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619008 00000100:00100000:3.0:1788748387.376866:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 327 00000100:00100000:3.0:1788748387.377545:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368619008:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748387.377570:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748387.378557:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b3d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.379020:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.379038:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748387.379049:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76200, rc 0) 00000100:00100000:3.0:1788748387.379138:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368619008:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 1603us (2717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748387.379148:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 327 00000100:00100000:2.0:1788748387.386959:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748387.387372:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619136 00000100:00100000:0.0:1788748387.388206:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619136 00000100:00100000:0.0:1788748387.388378:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 328 00000100:00100000:0.0:1788748387.388391:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368619136:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748387.390153:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368619136:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 1755us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748387.390168:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 328 00000100:00100000:3.0:1788748387.396558:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748387.398884:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619264 00000100:00100000:1.0:1788748387.398905:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619264 00000100:00100000:1.0:1788748387.398983:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 329 00000100:00100000:1.0:1788748387.398996:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368619264:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748387.399198:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368619264:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 203us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748387.399207:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 329 00010000:00010000:3.0:1788748387.624028:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748388.133447:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388620288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748388.133518:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748388.133660:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620288 00000100:00100000:2.0:1788748388.133669:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620288 00000100:00100000:2.0:1788748388.133716:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788748388.133726:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388620288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748388.133755:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748388.135657:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388620288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1924us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748388.135669:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788748388.138203:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388620288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748388.644819:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388620416:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.644894:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.644958:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388620928:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.644985:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645031:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388621440:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645073:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388621952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748388.645094:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645116:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788748388.645121:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388620544:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645152:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645179:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388621056:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645199:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645216:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388621568:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645236:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645264:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388620800:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645299:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388621312:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645338:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645356:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388621824:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645376:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645393:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788748388.645399:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8412ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388620672:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645453:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388621184:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645472:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645487:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388621696:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645506:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748388.645542:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620416 00000100:00100000:0.0:1788748388.645551:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620416 00000100:00100000:0.0:1788748388.645596:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788748388.645605:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388620416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645653:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388620416:12345-0@lo:400:kworker.0 Request processed in 49us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.645660:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788748388.645691:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620928 00000100:00100000:0.0:1788748388.645696:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620928 00000100:00100000:0.0:1788748388.645723:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621440 00000100:00100000:0.0:1788748388.645726:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621440 00000100:00100000:0.0:1788748388.645739:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620544 00000100:00100000:0.0:1788748388.645741:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620544 00000100:00100000:0.0:1788748388.645750:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621056 00000100:00100000:0.0:1788748388.645753:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621056 00000100:00100000:0.0:1788748388.645764:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621568 00000100:00100000:0.0:1788748388.645766:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621568 00000100:00100000:0.0:1788748388.645776:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620800 00000100:00100000:0.0:1788748388.645778:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620800 00000100:00100000:0.0:1788748388.645791:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788748388.645797:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388620928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645830:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388620928:12345-0@lo:400:kworker.0 Request processed in 33us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.645836:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788748388.645849:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788748388.645854:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388621440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645879:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388621440:12345-0@lo:400:kworker.0 Request processed in 25us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.645884:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788748388.645903:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788748388.645909:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388620544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645940:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388620544:12345-0@lo:400:kworker.0 Request processed in 30us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.645945:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788748388.645957:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788748388.645962:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388621056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.645987:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388621056:12345-0@lo:400:kworker.0 Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.645993:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788748388.646004:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788748388.646010:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388621568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646035:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388621568:12345-0@lo:400:kworker.0 Request processed in 26us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646041:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788748388.646051:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788748388.646057:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388620800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646086:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388620800:12345-0@lo:400:kworker.0 Request processed in 29us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646092:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788748388.646111:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621952 00000100:00100000:0.0:1788748388.646115:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621952 00000100:00100000:0.0:1788748388.646139:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788748388.646145:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388621952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788748388.646166:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748388.646218:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388621952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646224:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788748388.646253:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621312 00000100:00100000:0.0:1788748388.646256:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621312 00000100:00100000:0.0:1788748388.646312:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621824 00000100:00100000:0.0:1788748388.646335:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621824 00000100:00100000:0.0:1788748388.646350:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621184 00000100:00100000:0.0:1788748388.646353:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621184 00000100:00100000:0.0:1788748388.646363:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388621696 00000100:00100000:0.0:1788748388.646366:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388621696 00000100:00100000:0.0:1788748388.646376:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748388.646381:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388621312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646410:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388621312:12345-0@lo:400:kworker.0 Request processed in 29us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646416:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748388.646428:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788748388.646434:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388621824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646459:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388621824:12345-0@lo:400:kworker.0 Request processed in 26us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646464:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788748388.646474:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748388.646479:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388621184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646505:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388621184:12345-0@lo:400:kworker.0 Request processed in 26us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646511:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788748388.646521:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788748388.646526:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388621696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646561:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388621696:12345-0@lo:400:kworker.0 Request processed in 35us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646567:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788748388.646592:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388620672 00000100:00100000:0.0:1788748388.646596:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388620672 00000100:00100000:0.0:1788748388.646620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788748388.646626:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388620672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646658:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388620672:12345-0@lo:400:kworker.0 Request processed in 32us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748388.646664:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788748388.646690:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748388.646694:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748388.646697:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748388.646699:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748388.646732:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388620672:0@lo:400:kworker.0 00010000:00080000:0.0:1788748388.646746:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c7100 x1875638388621184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.646757:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388621184:0@lo:400:kworker.0 00010000:00080000:0.0:1788748388.646767:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c6d80 x1875638388621696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.646775:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388621696:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646786:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388620800:0@lo:400:kworker.0 00010000:00080000:0.0:1788748388.646796:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c4000 x1875638388621312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.646804:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388621312:0@lo:400:kworker.0 00010000:00080000:0.0:1788748388.646824:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c5500 x1875638388621824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.646832:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388621824:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646868:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388620544:0@lo:400:kworker.0 00010000:00080000:0.0:1788748388.646878:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c6a00 x1875638388621056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.646885:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388621056:0@lo:400:kworker.0 00010000:00080000:0.0:1788748388.646894:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c5f80 x1875638388621568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.646900:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388621568:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646910:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8412aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388620416:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646919:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388620928:0@lo:400:kworker.0 00000100:00100000:0.0:1788748388.646928:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388621440:0@lo:400:kworker.0 00010000:00080000:0.0:1788748388.646936:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c4e00 x1875638388621952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.646950:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388621952:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788748388.650656:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748388.650892:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748388.650912:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388622080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748388.650980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748388.656346:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622080 00000100:00100000:2.0:1788748388.656370:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622080 00000100:00100000:2.0:1788748388.656442:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748388.656452:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388622080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748388.656481:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748388.657383:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388622080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 929us (6399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748388.657394:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788748388.658387:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84267100 x1875638388622080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748388.658413:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388622080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748389.156515:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748389.156553:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388622208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748389.156623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748389.156715:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622208 00000100:00100000:0.0:1788748389.156723:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622208 00000100:00100000:0.0:1788748389.156772:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788748389.156781:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388622208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748389.156810:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748389.156866:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388622208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748389.156873:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788748389.156916:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c0700 x1875638388622208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748389.156934:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388622208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748389.158014:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748389.158030:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388622336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748389.158078:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748389.160209:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622336 00000100:00100000:0.0:1788748389.160222:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622336 00000100:00100000:0.0:1788748389.160289:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788748389.160299:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388622336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748389.160347:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748389.160433:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388622336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748389.160440:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788748389.160856:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4ee300 x1875638388622336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748389.160879:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388622336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748389.669788:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748389.858339:0:13374:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788748390.212677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748390.212725:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748390.212752:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748390.212781:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748390.212809:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748390.212946:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619392 00000100:00100000:3.0:1788748390.212961:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619392 00000100:00100000:3.0:1788748390.213043:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 331 00000100:00100000:3.0:1788748390.213056:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368619392:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748390.213141:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368619392:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 88us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748390.213148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 331 00000100:00100000:0.0:1788748390.213823:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619648 00000100:00100000:0.0:1788748390.213838:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619648 00000100:00100000:0.0:1788748390.213909:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619904 00000100:00100000:0.0:1788748390.213913:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619904 00000100:00100000:0.0:1788748390.213946:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619520 00000100:00100000:0.0:1788748390.213949:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619520 00000100:00100000:0.0:1788748390.213960:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368619776 00000100:00100000:0.0:1788748390.213963:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368619776 00000100:00100000:0.0:1788748390.213990:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:0.0:1788748390.214003:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368619648:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748390.214092:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368619648:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 92us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748390.214101:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:0.0:1788748390.214120:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:0.0:1788748390.214127:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368619904:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748390.214154:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368619904:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748390.214171:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:0.0:1788748390.214195:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:0.0:1788748390.214204:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368619520:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748390.214251:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368619520:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 50us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748390.214257:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00080000:3.0:1788748390.214270:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748390.214279:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00080000:3.0:1788748390.214281:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748390.214294:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368619776:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748390.214350:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368619776:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 59us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748390.214357:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 180 00010000:00010000:3.0:1788748390.692887:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748391.205817:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748391.205862:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388622464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748391.206073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748391.208439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622464 00000100:00100000:2.0:1788748391.208460:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622464 00000100:00100000:2.0:1788748391.208533:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788748391.208544:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388622464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748391.208590:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788748391.208692:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388622464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748391.208700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788748391.208785:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388622464:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748391.723513:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748392.740965:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748393.253118:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388622592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748393.253236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.253882:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622592 00000100:00100000:0.0:1788748393.253893:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622592 00000100:00100000:0.0:1788748393.254711:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788748393.254724:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388622592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748393.254773:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788748393.254861:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388622592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.254868:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788748393.255247:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388622592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788748393.765057:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748393.777604:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388622720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748393.777696:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.777774:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748393.777781:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388622848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748393.777820:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.777863:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622720 00000100:00100000:0.0:1788748393.777872:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622720 00000100:00100000:0.0:1788748393.777929:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622848 00000100:00100000:0.0:1788748393.777933:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622848 00000100:00100000:0.0:1788748393.777954:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788748393.777965:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388622720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748393.778003:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748393.778054:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388622720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.778061:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788748393.778081:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788748393.778101:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388622848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788748393.778113:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748393.778162:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388622848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.778168:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788748393.778191:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748393.778221:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c3b80 x1875638388622848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748393.778242:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388622848:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788748393.778252:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c0a80 x1875638388622720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748393.778262:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388622720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748393.782030:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388622976:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782188:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388623488:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782218:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782236:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388624000:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782256:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782281:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788748393.782286:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388623104:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782344:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388623616:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782365:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782393:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388624128:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782425:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782454:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388623232:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782520:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388623744:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782545:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782564:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788748393.782570:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388623360:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782591:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782601:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388623872:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782620:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748393.782656:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388622976 00000100:00100000:0.0:1788748393.782665:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388622976 00000100:00100000:0.0:1788748393.782720:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788748393.782730:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388622976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782790:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388622976:12345-0@lo:400:kworker.0 Request processed in 62us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.782797:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788748393.782832:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388623488 00000100:00100000:0.0:1788748393.782836:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388623488 00000100:00100000:0.0:1788748393.782867:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624000 00000100:00100000:0.0:1788748393.782870:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624000 00000100:00100000:0.0:1788748393.782882:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388623104 00000100:00100000:0.0:1788748393.782885:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388623104 00000100:00100000:0.0:1788748393.782895:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388623616 00000100:00100000:0.0:1788748393.782897:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388623616 00000100:00100000:0.0:1788748393.782910:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624128 00000100:00100000:0.0:1788748393.782912:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624128 00000100:00100000:0.0:1788748393.782924:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388623360 00000100:00100000:0.0:1788748393.782932:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388623360 00000100:00100000:0.0:1788748393.782950:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788748393.782957:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388623488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.782994:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388623488:12345-0@lo:400:kworker.0 Request processed in 38us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783000:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788748393.783013:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788748393.783019:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388624000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783043:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388624000:12345-0@lo:400:kworker.0 Request processed in 25us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783048:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788748393.783057:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788748393.783061:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388623104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783080:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388623104:12345-0@lo:400:kworker.0 Request processed in 19us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783085:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788748393.783094:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788748393.783099:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388623616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783126:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388623616:12345-0@lo:400:kworker.0 Request processed in 27us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783131:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788748393.783154:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788748393.783160:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388624128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783184:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388624128:12345-0@lo:400:kworker.0 Request processed in 25us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783197:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788748393.783208:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788748393.783213:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388623360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783252:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388623360:12345-0@lo:400:kworker.0 Request processed in 39us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783257:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788748393.783290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388623232 00000100:00100000:0.0:1788748393.783293:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388623232 00000100:00100000:0.0:1788748393.783335:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788748393.783342:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388623232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783376:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388623232:12345-0@lo:400:kworker.0 Request processed in 35us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788748393.783402:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388623744 00000100:00100000:0.0:1788748393.783405:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388623744 00000100:00100000:0.0:1788748393.783430:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388623872 00000100:00100000:0.0:1788748393.783433:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388623872 00000100:00100000:0.0:1788748393.783452:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748393.783459:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388623744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783492:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388623744:12345-0@lo:400:kworker.0 Request processed in 33us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783497:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788748393.783509:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748393.783514:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388623872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783543:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388623872:12345-0@lo:400:kworker.0 Request processed in 29us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748393.783558:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748393.783607:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388623104:0@lo:400:kworker.0 00010000:00080000:0.0:1788748393.783621:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c5f80 x1875638388623616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748393.783633:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388623616:0@lo:400:kworker.0 00010000:00080000:0.0:1788748393.783643:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c6d80 x1875638388624128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748393.783651:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388624128:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783660:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388622976:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783670:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388623488:0@lo:400:kworker.0 00000100:00100000:0.0:1788748393.783680:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388624000:0@lo:400:kworker.0 00000100:00080000:0.0:1788748393.783714:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748393.783719:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748393.783722:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748393.784230:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388623360:0@lo:400:kworker.0 00010000:00080000:1.0:1788748393.784244:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c5500 x1875638388623872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748393.784254:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388623872:0@lo:400:kworker.0 00000100:00100000:1.0:1788748393.784265:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388623232:0@lo:400:kworker.0 00010000:00080000:1.0:1788748393.784276:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c6a00 x1875638388623744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748393.784283:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388623744:0@lo:400:kworker.0 00000100:00100000:2.0:1788748394.276951:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748394.276981:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388624256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748394.277072:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748394.277531:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624256 00000100:00100000:0.0:1788748394.277543:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624256 00000100:00100000:0.0:1788748394.277613:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788748394.277624:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388624256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748394.277683:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748394.277765:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388624256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748394.277773:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1788748394.278444:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bce00 x1875638388624256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748394.278469:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388624256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748394.279181:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748394.279200:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388624384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748394.279263:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748394.279542:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624384 00000100:00100000:0.0:1788748394.279570:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624384 00000100:00100000:0.0:1788748394.279624:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788748394.279634:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388624384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748394.279678:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748394.279949:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388624384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 316us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748394.279957:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788748394.280041:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bc000 x1875638388624384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748394.280061:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388624384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748394.788591:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748395.325877:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748395.325915:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748395.325946:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748395.325965:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748395.325982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748395.326158:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368620032 00000100:00100000:0.0:1788748395.326169:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368620032 00000100:00100000:0.0:1788748395.326221:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 333 00000100:00100000:0.0:1788748395.326231:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368620032:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748395.326312:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368620032:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 82us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748395.326341:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 333 00000100:00100000:0.0:1788748395.326371:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368620288 00000100:00100000:0.0:1788748395.326375:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368620288 00000100:00100000:0.0:1788748395.326402:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368620544 00000100:00100000:0.0:1788748395.326405:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368620544 00000100:00100000:0.0:1788748395.326415:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368620160 00000100:00100000:0.0:1788748395.326417:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368620160 00000100:00100000:0.0:1788748395.326427:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368620416 00000100:00100000:0.0:1788748395.326429:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368620416 00000100:00100000:0.0:1788748395.326442:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:0.0:1788748395.326448:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368620288:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748395.326477:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368620288:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748395.326484:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:0.0:1788748395.326494:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:0.0:1788748395.326513:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368620544:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748395.326534:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368620544:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748395.326540:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:0.0:1788748395.326550:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:0.0:1788748395.326556:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368620160:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748395.326574:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368620160:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 19us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748395.326580:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:0.0:1788748395.326589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:0.0:1788748395.326594:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368620416:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748395.326612:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368620416:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 18us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748395.326618:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00080000:1.0:1788748395.326757:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748395.326762:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788748395.814159:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748396.187598:0:13523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:33:14 (1788748394) === 00000100:00100000:2.0:1788748396.324478:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748396.324511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388624512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748396.324580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748396.324678:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624512 00000100:00100000:2.0:1788748396.324686:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624512 00000100:00100000:2.0:1788748396.324731:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788748396.324739:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388624512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748396.324772:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788748396.324815:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388624512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748396.324822:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788748396.324866:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388624512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748396.528051:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748396.528091:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.528593:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368620672 00000100:00100000:3.0:1788748396.528602:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368620672 00000100:00100000:3.0:1788748396.528722:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1788748396.528732:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368620672:12345-192.168.203.22@tcp:41:mkdir.0 00000004:00000024:3.0:1788748396.528762:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788748396.528840:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368620672:12345-192.168.203.22@tcp:41:mkdir.0 Request processed in 109us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748396.528857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1788748396.532804:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368620800 00000100:00100000:2.0:1788748396.532815:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368620800 00000100:00100000:2.0:1788748396.532877:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1788748396.532887:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:10500:x1875638368620800:12345-192.168.203.22@tcp:700:mkdir.0 00000100:00100000:2.0:1788748396.532959:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:10500:x1875638368620800:12345-192.168.203.22@tcp:700:mkdir.0 Request processed in 75us (4868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748396.532967:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1788748396.536931:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.537679:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368621056 00000100:00100000:3.0:1788748396.537689:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368621056 00000100:00100000:3.0:1788748396.537771:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1788748396.537781:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:10500:x1875638368621056:12345-192.168.203.22@tcp:36:mkdir.0 00010000:00010000:3.0:1788748396.537831:0:10244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748396.537901:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e19f79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ab1 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.537919:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113900) 00010000:00010000:3.0:1788748396.537929:0:10244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748396.538008:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538021:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538033:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538044:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538050:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538056:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538534:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538549:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538556:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748396.538570:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001f9a7ae2 reply state 00000000e1787d25 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538581:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538588:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8addb5113d00) 00010000:00010000:3.0:1788748396.538590:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748396.538593:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788748396.538597:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788748396.538604:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538610:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538616:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538623:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6e00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748396.538626:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538633:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538651:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113b00) 00010000:00010000:3.0:1788748396.538653:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748396.538657:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538664:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748396.538679:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001f9a7ae2 reply state 00000000e1787d25 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538687:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.538693:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8addb5113700) 00010000:00010000:3.0:1788748396.538695:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748396.538697:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788748396.538773:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:10500:x1875638368621056:12345-192.168.203.22@tcp:36:mkdir.0 Request processed in 991us (1847us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788748396.538780:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1788748396.559425:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.559516:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368621184 00000100:00100000:3.0:1788748396.559531:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368621184 00000100:00100000:3.0:1788748396.559621:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788748396.559636:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:10501:x1875638368621184:12345-192.168.203.22@tcp:101:chmod.0 00010000:00010000:3.0:1788748396.559664:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748396.559691:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b44 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.559767:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a0f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.559800:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.559825:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748396.559877:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788748396.559881:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748396.559925:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.559953:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a0ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b44 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.559974:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b44 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.559984:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113b00) 00010000:00010000:3.0:1788748396.559987:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748396.559990:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f7000, rc 0) 00000100:00100000:3.0:1788748396.560061:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:10501:x1875638368621184:12345-192.168.203.22@tcp:101:chmod.0 Request processed in 430us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748396.560068:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1788748396.567067:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.567156:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368621440 00000100:00100000:0.0:1788748396.567165:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368621440 00000100:00100000:0.0:1788748396.567222:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788748396.567232:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:10501:x1875638368621440:12345-192.168.203.22@tcp:36:chmod.0 00010000:00010000:0.0:1788748396.567279:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748396.567304:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a0f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b44 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.567362:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113b00) 00010000:00010000:0.0:1788748396.567383:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748396.567409:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.567422:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.567432:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748396.567605:0:8447:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000e17c6df reply state 0000000045c4c64f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.567618:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.567624:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add97552000) 00010000:00010000:0.0:1788748396.567627:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788748396.567629:0:8447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788748396.567636:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788748396.567707:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:10501:x1875638368621440:12345-192.168.203.22@tcp:36:chmod.0 Request processed in 476us (649us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788748396.567714:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1788748396.603478:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.603677:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368621568 00000100:00100000:3.0:1788748396.603689:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368621568 00000100:00100000:3.0:1788748396.603762:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1788748396.603774:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:10502:x1875638368621568:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:3.0:1788748396.603808:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748396.603971:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b4b expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.604063:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a108 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.604080:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.604093:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748396.604409:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788748396.604414:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748396.604464:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.604499:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6e00/0x9ba0f20a02e1a101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b4b expref: 11 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.604521:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b4b expref: 10 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.604595:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add97552000) 00010000:00010000:3.0:1788748396.604599:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748396.604604:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add839f7000, rc 0) 00000100:00100000:3.0:1788748396.604733:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:10502:x1875638368621568:12345-192.168.203.22@tcp:101:chown.0 Request processed in 960us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748396.604741:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:2.0:1788748396.608894:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.608993:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368621696 00000100:00100000:3.0:1788748396.609024:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368621696 00000100:00100000:3.0:1788748396.609099:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1788748396.609111:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:10502:x1875638368621696:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:3.0:1788748396.609150:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748396.609180:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a10f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b52 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609266:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609283:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609296:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609307:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609372:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609381:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609786:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a124 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609797:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609805:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748396.609869:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788748396.609874:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748396.609899:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609913:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609920:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609927:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609933:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748396.609938:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609947:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609962:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add97552000) 00010000:00010000:3.0:1788748396.609965:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748396.609971:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609978:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.609992:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610009:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610015:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610020:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748396.610023:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610030:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610038:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8addb5113700) 00010000:00010000:3.0:1788748396.610040:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748396.610043:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610049:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a11d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610084:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a10f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b52 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610098:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a124 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b52 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.610106:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8addb5113d00) 00010000:00010000:3.0:1788748396.610108:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748396.610128:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbac00, rc 0) 00000100:00100000:3.0:1788748396.610215:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:10502:x1875638368621696:12345-192.168.203.22@tcp:101:chown.0 Request processed in 1105us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748396.610223:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:2.0:1788748396.613675:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.615971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368621824 00000100:00100000:0.0:1788748396.615994:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368621824 00000100:00100000:1.0:1788748396.616143:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1788748396.616171:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:10502:x1875638368621824:12345-192.168.203.22@tcp:900:chown.0 00000100:00100000:1.0:1788748396.616381:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:10502:x1875638368621824:12345-192.168.203.22@tcp:900:chown.0 Request processed in 223us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748396.616389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1788748396.623146:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748396.623278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368622080 00000100:00100000:1.0:1788748396.623290:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368622080 00000100:00100000:1.0:1788748396.623404:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1788748396.623417:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:10502:x1875638368622080:12345-192.168.203.22@tcp:36:chown.0 00010000:00010000:1.0:1788748396.623491:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748396.623526:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a124 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b52 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.623655:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8addb5113d00) 00010000:00010000:1.0:1788748396.623661:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748396.623691:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.623707:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.623718:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748396.650506:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1788748396.650701:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650714:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650723:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650740:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f6800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748396.650745:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650752:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650770:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8addb5113700) 00010000:00010000:1.0:1788748396.650773:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748396.650777:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650784:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f6800/0x9ba0f20a02e1a0de lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650816:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650823:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650829:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650833:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f7800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748396.650836:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650841:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650859:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8addb5113d00) 00010000:00010000:1.0:1788748396.650862:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748396.650865:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650871:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7800/0x9ba0f20a02e1a0e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650885:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650892:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650898:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650905:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748396.650908:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650913:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650921:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add97552000) 00010000:00010000:1.0:1788748396.650923:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788748396.650927:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.650932:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a0fa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748396.652741:0:6511:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b0000634 reply state 00000000a2e2cebb transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.652764:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.652773:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8addb5113d00) 00010000:00010000:0.0:1788748396.652788:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788748396.652793:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788748396.652806:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788748396.652911:0:6511:0:(ldlm_lib.c:3495:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788748396.652939:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:10502:x1875638368622080:12345-192.168.203.22@tcp:36:chown.0 Request processed in 29521us (29815us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788748396.652948:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00010000:00010000:3.0:1788748396.655598:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.655612:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.655620:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.655627:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748396.655631:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.655639:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.655655:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8addb5113d00) 00010000:00010000:3.0:1788748396.655658:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788748396.655663:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.655669:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a12b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748396.693600:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.693835:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368622208 00000100:00100000:3.0:1788748396.693846:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368622208 00000100:00100000:3.0:1788748396.693905:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1788748396.693915:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:10503:x1875638368622208:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:3.0:1788748396.693945:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748396.693965:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b59 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748396.695553:0:10244:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1539us 00010000:00010000:0.0:1788748396.723041:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.723064:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.723077:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.723093:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.723101:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.723108:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.724944:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.724964:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.724976:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748396.725031:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788748396.725035:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748396.725076:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.725089:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.725096:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.725103:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.725109:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748396.725113:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.725132:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.725144:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add97552000) 00010000:00010000:0.0:1788748396.726879:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748396.726892:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726902:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726920:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726941:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726949:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726955:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748396.726958:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726965:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726977:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8add97552800) 00010000:00010000:0.0:1788748396.726980:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748396.726983:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.726988:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.727035:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b59 expref: 8 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.727049:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b59 expref: 7 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.727057:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:0.0:1788748396.727059:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788748396.727069:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748396.728388:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:10503:x1875638368622208:12345-192.168.203.22@tcp:101:touch.500 Request processed in 34469us (34792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748396.728398:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1788748396.763896:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.764164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368622464 00000100:00100000:3.0:1788748396.764173:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368622464 00000100:00100000:3.0:1788748396.764230:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1788748396.764241:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:10503:x1875638368622464:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:3.0:1788748396.764262:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748396.764282:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a14e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b60 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.764474:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.764490:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.764502:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.764532:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.764541:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.764548:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788748396.765533:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788748396.765719:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fba00/0x9ba0f20a02e1a163 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765747:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fba00/0x9ba0f20a02e1a163 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765756:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fba00/0x9ba0f20a02e1a163 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765789:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765796:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765804:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765822:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbbe00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748396.765826:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765834:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765846:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:2.0:1788748396.765849:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748396.765854:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765861:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a155 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748396.765883:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000741477d3 reply state 0000000014361a14 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765895:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765901:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff8addb5113d00) 00010000:00010000:2.0:1788748396.765904:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748396.765907:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788748396.765941:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a14e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b60 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765956:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fba00/0x9ba0f20a02e1a163 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b60 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748396.765964:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adc8259aa00) 00010000:00010000:2.0:1788748396.765967:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748396.765969:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813fba00, rc 0) 00000100:00100000:2.0:1788748396.766228:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:10503:x1875638368622464:12345-192.168.203.22@tcp:101:touch.500 Request processed in 1987us (2338us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788748396.766237:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1788748396.782176:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.782517:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368622720 00000100:00100000:0.0:1788748396.782527:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368622720 00000100:00100000:0.0:1788748396.782593:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788748396.782603:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:10503:x1875638368622720:12345-192.168.203.22@tcp:36:touch.500 00010000:00010000:0.0:1788748396.782662:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748396.782687:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fba00/0x9ba0f20a02e1a163 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b60 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.782707:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8adc8259aa00) 00010000:00010000:0.0:1788748396.782717:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748396.782962:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.782977:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.782988:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748396.783090:0:6511:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005b0b91de reply state 0000000092b1fa5f transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.783103:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.783109:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8add97552800) 00010000:00010000:0.0:1788748396.783137:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788748396.783140:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748396.783384:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:10503:x1875638368622720:12345-192.168.203.22@tcp:36:touch.500 Request processed in 781us (1216us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788748396.783392:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788748396.801675:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748396.801772:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368622848 00000100:00100000:1.0:1788748396.801782:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368622848 00000100:00100000:1.0:1788748396.801853:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1788748396.801864:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:10503:x1875638368622848:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:1.0:1788748396.801887:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748396.801909:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a178 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b67 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.801964:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a178 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b67 expref: 12 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.801980:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a178 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b67 expref: 12 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.801998:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8add97552800) 00010000:00010000:1.0:1788748396.802001:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748396.802005:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69200, rc 0) 00000100:00100000:1.0:1788748396.802065:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:10503:x1875638368622848:12345-192.168.203.22@tcp:101:touch.500 Request processed in 203us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748396.802072:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:2.0:1788748396.805902:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.806004:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368622976 00000100:00100000:0.0:1788748396.806014:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368622976 00000100:00100000:0.0:1788748396.806064:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1788748396.806072:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2409:x1875638368622976:12345-192.168.203.22@tcp:8:touch.500 00010000:00080000:0.0:1788748396.806103:0:8427:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:0.0:1788748396.806145:0:8427:0:(genops.c:1384:class_connect()) connect: client 53dfbad0-5125-4663-8fa7-3e1aae0338a8, cookie 0x9ba0f20a02e1a17f 00002000:00100000:0.0:1788748396.806158:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 53dfbad0-5125-4663-8fa7-3e1aae0338a8/ffff8addbf46e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788748396.806176:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788748396.806251:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788748396.806280:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8addbf46a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748396.806389:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2409:x1875638368622976:12345-192.168.203.22@tcp:8:touch.500 Request processed in 315us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748396.806397:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1788748396.812082:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.812277:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368623104 00000100:00100000:0.0:1788748396.812288:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368623104 00000100:00100000:0.0:1788748396.812398:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788748396.812409:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:0:x1875638368623104:12345-192.168.203.22@tcp:2:touch.500 00000100:00080000:1.0:1788748396.813031:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788748396.814281:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1788748396.814293:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000100:00100000:0.0:1788748396.814575:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:0:x1875638368623104:12345-192.168.203.22@tcp:2:touch.500 Request processed in 2162us (2496us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788748396.814585:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:1.0:1788748396.825037:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.825151:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368623360 00000100:00100000:3.0:1788748396.825162:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368623360 00000100:00100000:3.0:1788748396.825217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788748396.825229:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:10503:x1875638368623360:12345-192.168.203.22@tcp:35:touch.500 00000100:00100000:3.0:1788748396.825574:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:10503:x1875638368623360:12345-192.168.203.22@tcp:35:touch.500 Request processed in 346us (544us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788748396.825582:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00010000:00010000:1.0:1788748396.836635:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748396.850829:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.850970:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368623488 00000100:00100000:0.0:1788748396.850980:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368623488 00000100:00100000:0.0:1788748396.851041:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1788748396.851052:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:10504:x1875638368623488:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:0.0:1788748396.851077:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748396.851097:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.851172:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a18d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.851187:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.851199:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748396.851246:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788748396.851250:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748396.851290:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.851339:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b6e expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.851360:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a18d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b6e expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748396.851368:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:0.0:1788748396.851371:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748396.851393:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940200, rc 0) 00000100:00100000:1.0:1788748396.851486:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:10504:x1875638368623488:12345-192.168.203.22@tcp:101:rm.0 Request processed in 434us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748396.851502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1788748396.858908:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.862451:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368623744 00000100:00100000:0.0:1788748396.862466:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368623744 00000100:00100000:1.0:1788748396.869970:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:1.0:1788748396.869986:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:10504:x1875638368623744:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:1.0:1788748396.870007:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748396.870026:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b75 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748396.870131:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788748396.870282:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a194 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b75 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.870295:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add97552000) 00010000:00010000:1.0:1788748396.870298:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748396.870303:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b75 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.870344:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68200, rc 0) 00000100:00100000:1.0:1788748396.870418:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:10504:x1875638368623744:12345-192.168.203.22@tcp:101:rm.0 Request processed in 437us (11520us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1788748396.870425:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:0.0:1788748396.881071:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.881384:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368623872 00000100:00100000:3.0:1788748396.881393:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368623872 00000100:00100000:3.0:1788748396.881452:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1788748396.881464:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:10504:x1875638368623872:12345-192.168.203.22@tcp:37:rm.0 00000100:00100000:2.0:1788748396.893275:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:10504:x1875638368623872:12345-192.168.203.22@tcp:37:rm.0 Request processed in 11795us (12194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748396.893305:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1788748396.914394:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748396.924081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368624128 00000100:00100000:0.0:1788748396.924096:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368624128 00000100:00100000:0.0:1788748396.924181:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1788748396.924192:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda703b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:10504:x1875638368624128:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:0.0:1788748396.924463:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda703b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:10504:x1875638368624128:12345-192.168.203.22@tcp:35:rm.0 Request processed in 271us (10078us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788748396.924471:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1788748396.941695:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.942567:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368624384 00000100:00100000:3.0:1788748396.942579:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368624384 00000100:00100000:3.0:1788748396.942647:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1788748396.942657:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:10504:x1875638368624384:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:3.0:1788748396.942684:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748396.942715:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b7c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.942833:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a1a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.942850:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.942889:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748396.942902:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788748396.943032:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b7c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.943050:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a1a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b7c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.943058:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:3.0:1788748396.943061:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788748396.943064:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbbe00, rc 0) 00000100:00100000:3.0:1788748396.943538:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:10504:x1875638368624384:12345-192.168.203.22@tcp:101:rm.0 Request processed in 880us (1850us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788748396.943547:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1788748396.948746:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748396.949295:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368624512 00000100:00100000:2.0:1788748396.949305:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368624512 00000100:00100000:2.0:1788748396.949383:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1788748396.949393:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:10504:x1875638368624512:12345-192.168.203.22@tcp:41:rm.0 00000004:00000024:2.0:1788748396.949445:0:8447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788748396.949513:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:10504:x1875638368624512:12345-192.168.203.22@tcp:41:rm.0 Request processed in 121us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748396.949520:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:0.0:1788748396.956127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748396.956219:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368624640 00000100:00100000:1.0:1788748396.956229:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368624640 00000100:00100000:1.0:1788748396.956297:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:1.0:1788748396.956308:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:10504:x1875638368624640:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:1.0:1788748396.956371:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748396.956406:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b83 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956469:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956484:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956495:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956506:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956513:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956520:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956616:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a1cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956626:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956633:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748396.956668:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788748396.956672:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748396.956689:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.956999:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957009:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957015:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957022:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957029:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748396.957033:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957041:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957052:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:1.0:1788748396.957056:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748396.957061:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957067:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957078:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957083:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957096:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957101:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748396.957104:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957111:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957130:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff8addb5113d00) 00010000:00010000:1.0:1788748396.957133:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748396.957136:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957142:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957169:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b83 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957183:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a1cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b83 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.957190:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8add97552800) 00010000:00010000:1.0:1788748396.957192:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748396.957195:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68400, rc 0) 00000100:00100000:1.0:1788748396.957265:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:10504:x1875638368624640:12345-192.168.203.22@tcp:101:rm.0 Request processed in 959us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748396.957282:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1788748396.968585:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.968666:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368624896 00000100:00100000:3.0:1788748396.968675:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368624896 00000100:00100000:3.0:1788748396.968743:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1788748396.968753:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:10504:x1875638368624896:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:3.0:1788748396.968819:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788748396.968843:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a1cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b83 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969083:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a178 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b67 expref: 18 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969126:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8add97552800) 00010000:00010000:3.0:1788748396.969140:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a18d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b6e expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969150:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:3.0:1788748396.969153:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748396.969175:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969188:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969197:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969208:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969215:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969222:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969533:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969543:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.969561:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748396.970189:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788748396.970202:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313956885123ns, next at 314956882020ns, rc = 0 00010000:00010000:3.0:1788748396.970638:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.970651:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.970660:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.970668:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.970675:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.970682:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971001:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748396.971026:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971033:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971039:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971055:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbac00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748396.971060:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971068:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971081:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8add97552800) 00010000:00010000:3.0:1788748396.971084:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788748396.971088:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971094:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a1e1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971126:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971133:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971139:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971144:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748396.971147:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971153:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971172:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:3.0:1788748396.971174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748396.971177:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971182:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a1d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748396.971193:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000065380e30 reply state 000000000988c229 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971205:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748396.971211:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff8addb5113d00) 00010000:00010000:3.0:1788748396.971213:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748396.971215:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748396.974471:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:10504:x1875638368624896:12345-192.168.203.22@tcp:36:rm.0 Request processed in 2563us (2739us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788748396.974485:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:0.0:1788748396.976386:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748396.976662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368625152 00000100:00100000:3.0:1788748396.976673:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368625152 00000100:00100000:3.0:1788748396.976735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1788748396.976745:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:10504:x1875638368625152:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:3.0:1788748396.977220:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:10504:x1875638368625152:12345-192.168.203.22@tcp:35:rm.0 Request processed in 475us (840us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788748396.977228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00010000:00010000:1.0:1788748396.982578:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748396.982593:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.982604:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76600 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748396.982609:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.982618:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.982638:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8add97552800) 00010000:00010000:1.0:1788748396.982641:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788748396.982646:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.982653:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76600/0x9ba0f20a02e1a1e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748396.985219:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748396.985555:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368625408 00000100:00100000:1.0:1788748396.985565:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368625408 00000100:00100000:1.0:1788748396.985617:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1788748396.985627:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:10504:x1875638368625408:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:1.0:1788748396.985710:0:10244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788748396.985734:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a1a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b7c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.985753:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b59 expref: 18 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.985769:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8add97552e00) 00010000:00010000:1.0:1788748396.985797:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add839f7000/0x9ba0f20a02e1a108 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b4b expref: 17 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.985814:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add97552000) 00010000:00010000:1.0:1788748396.985820:0:10244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748396.985843:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.985996:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.986009:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.986024:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.986032:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.986039:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.986131:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.986139:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.986157:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748396.986667:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788748396.986683:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987246:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987582:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987589:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748396.987594:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987601:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987614:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8addba6a9b00) 00010000:00010000:1.0:1788748396.987617:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788748396.987622:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987628:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a1fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987651:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987657:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987674:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987679:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748396.987682:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987687:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987708:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addba6a9800) 00010000:00010000:1.0:1788748396.987711:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748396.987714:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987720:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a1ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748396.987731:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000031bbd3a7 reply state 000000009b6e72d6 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987743:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748396.987750:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8addba6a9000) 00010000:00010000:1.0:1788748396.987752:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748396.987755:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788748396.988521:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748396.988526:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748396.988528:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748396.989047:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:10504:x1875638368625408:12345-192.168.203.22@tcp:36:rm.0 Request processed in 3414us (3831us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788748396.989057:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00010000:00010000:3.0:1788748397.861239:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748398.374554:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748398.374579:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388624640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748398.374651:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748398.374769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624640 00000100:00100000:1.0:1788748398.374776:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624640 00000100:00100000:1.0:1788748398.374825:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788748398.374834:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388624640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748398.374877:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748398.374934:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388624640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748398.374942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788748398.374995:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388624640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748398.884838:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388624768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748398.884907:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.885825:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388625024:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.885870:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.885891:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388625536:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.885912:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.885926:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388626048:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.885945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.885966:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788748398.885971:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388625152:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.885993:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.886009:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388625664:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.886030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.886045:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388626176:0@lo:400:kworker.0 00000100:00100000:3.0:1788748398.886064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748398.886100:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625024 00000100:00100000:3.0:1788748398.886118:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625024 00000100:00100000:3.0:1788748398.886157:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625536 00000100:00100000:3.0:1788748398.886160:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625536 00000100:00100000:3.0:1788748398.886184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388626048 00000100:00100000:3.0:1788748398.886187:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388626048 00000100:00100000:3.0:1788748398.886203:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788748398.886210:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388625024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.886388:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625664 00000100:00100000:0.0:1788748398.886393:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625664 00000100:00100000:0.0:1788748398.886416:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388626176 00000100:00100000:0.0:1788748398.886419:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388626176 00000100:00100000:0.0:1788748398.886435:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748398.886441:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388625664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.886585:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624768 00000100:00100000:2.0:1788748398.886589:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624768 00000100:00100000:2.0:1788748398.886619:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788748398.886626:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388624768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748398.886649:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748398.892794:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388625664:12345-0@lo:400:kworker.0 Request processed in 6343us (6752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748398.892809:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788748398.892848:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748398.892861:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388626176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.892915:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388626176:12345-0@lo:400:kworker.0 Request processed in 59us (6849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748398.892921:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788748398.892961:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388624896:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893001:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.893041:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388625408:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.893367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388625920:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893387:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.893405:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788748398.893411:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388625280:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893434:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.893446:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388625792:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893467:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.893485:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388626304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748398.893506:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748398.893530:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388624896 00000100:00100000:0.0:1788748398.893538:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388624896 00000100:00100000:0.0:1788748398.893572:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788748398.893578:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388624896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893625:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388624896:12345-0@lo:400:kworker.0 Request processed in 47us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748398.893632:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788748398.893660:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788748398.893668:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00010000:00080000:0.0:1788748398.893781:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b0a680 x1875638388625664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748398.893795:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388625664:0@lo:400:kworker.0 00010000:00080000:0.0:1788748398.893808:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b0aa00 x1875638388626176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748398.893815:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388626176:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893844:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388624896:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893860:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625792 00000100:00100000:0.0:1788748398.893864:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625792 00000100:00100000:0.0:1788748398.893891:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788748398.893897:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388625792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893931:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388625792:12345-0@lo:400:kworker.0 Request processed in 35us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748398.893937:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788748398.893962:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b08000 x1875638388625792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748398.893971:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388625792:0@lo:400:kworker.0 00000100:00100000:0.0:1788748398.893999:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388626304 00000100:00100000:0.0:1788748398.894002:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388626304 00000100:00100000:0.0:1788748398.894084:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788748398.894091:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388626304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788748398.894119:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748398.894154:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388626304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748398.894161:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788748398.894185:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f160000 x1875638388626304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748398.894198:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388626304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748398.894470:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388624768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7843us (9562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748398.894478:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788748398.894505:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625408 00000100:00100000:2.0:1788748398.894509:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625408 00000100:00100000:2.0:1788748398.894526:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625920 00000100:00100000:2.0:1788748398.894529:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625920 00000100:00100000:2.0:1788748398.894540:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625280 00000100:00100000:2.0:1788748398.894542:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625280 00000100:00100000:2.0:1788748398.894554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788748398.894569:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388625536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.894610:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388625536:12345-0@lo:400:kworker.0 Request processed in 43us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748398.894616:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788748398.894629:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788748398.894634:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388626048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.894662:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388626048:12345-0@lo:400:kworker.0 Request processed in 28us (8716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748398.894668:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788748398.894678:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788748398.894683:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388625408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.894712:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388625408:12345-0@lo:400:kworker.0 Request processed in 29us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748398.894717:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788748398.894727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788748398.894732:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388625920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.894758:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388625920:12345-0@lo:400:kworker.0 Request processed in 26us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748398.894784:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788748398.894796:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788748398.894802:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388625280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.894827:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388625280:12345-0@lo:400:kworker.0 Request processed in 26us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748398.894832:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788748398.894855:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388625152 00000100:00100000:2.0:1788748398.894865:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388625152 00000100:00100000:2.0:1788748398.894892:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788748398.894899:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388625152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.894931:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388625152:12345-0@lo:400:kworker.0 Request processed in 33us (8937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748398.894936:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788748398.894978:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388625152:0@lo:400:kworker.0 00010000:00080000:2.0:1788748398.894989:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b08a80 x1875638388625536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748398.894997:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388625536:0@lo:400:kworker.0 00010000:00080000:2.0:1788748398.895005:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83b09180 x1875638388626048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748398.895014:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388626048:0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.895041:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388625280:0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.895049:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388625408:0@lo:400:kworker.0 00000100:00100000:2.0:1788748398.895058:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388625920:0@lo:400:kworker.0 00010000:00080000:0.0:1788748398.896616:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c4e00 x1875638388624768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748398.896637:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388624768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788748398.899256:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748398.903876:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388625024:12345-0@lo:400:kworker.0 Request processed in 17657us (17996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748398.903888:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1788748398.903922:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748398.903926:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748398.903941:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748398.903943:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748398.907389:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388625024:0@lo:400:kworker.0 00000100:00100000:2.0:1788748399.396839:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388626432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748399.396982:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788748399.398072:0:8741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316384753609ns, next at 317384750864ns, rc = 0 00000100:00100000:3.0:1788748399.398611:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388626432 00000100:00100000:3.0:1788748399.398626:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388626432 00000100:00100000:3.0:1788748399.398677:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788748399.398686:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388626432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748399.398713:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748399.401105:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388626560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748399.401174:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748399.401373:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388626560 00000100:00100000:2.0:1788748399.401381:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388626560 00000100:00100000:2.0:1788748399.401417:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788748399.401426:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388626560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748399.401448:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748399.402163:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388626560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 734us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748399.402172:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1788748399.402377:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c4e00 x1875638388626560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748399.402398:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388626560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748399.402487:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388626432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3801us (5504us total) trans 0 rc 0/0 00010000:00080000:2.0:1788748399.402766:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c3b80 x1875638388626432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748399.402780:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388626432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748399.402864:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:0.0:1788748399.911651:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748400.438965:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748400.439017:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748400.439064:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748400.439178:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368625536 00000100:00100000:2.0:1788748400.439191:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368625536 00000100:00100000:2.0:1788748400.439268:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 335 00000100:00100000:2.0:1788748400.439281:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368625536:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748400.439400:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368625536:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 121us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748400.439407:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 335 00000100:00100000:1.0:1788748400.439592:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368625792 00000100:00100000:1.0:1788748400.439597:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368625792 00000100:00100000:1.0:1788748400.439657:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626048 00000100:00100000:1.0:1788748400.439661:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626048 00000100:00100000:1.0:1788748400.439686:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:1.0:1788748400.439694:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368625792:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748400.439732:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368625792:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748400.439739:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:1.0:1788748400.439753:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:1.0:1788748400.439759:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368626048:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748400.439785:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368626048:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748400.439791:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00080000:2.0:1788748400.439908:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748400.439912:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748400.443904:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748400.443951:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748400.443991:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748400.444147:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368625664 00000100:00100000:2.0:1788748400.444160:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368625664 00000100:00100000:2.0:1788748400.444238:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626176 00000100:00100000:2.0:1788748400.444242:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626176 00000100:00100000:2.0:1788748400.444274:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:2.0:1788748400.444285:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:2411:x1875638368625664:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748400.444424:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:2411:x1875638368625664:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 141us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748400.444432:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:2.0:1788748400.444450:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:2.0:1788748400.444456:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368626176:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748400.444497:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368626176:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 42us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748400.444504:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00080000:0.0:1788748400.444911:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748400.444917:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748400.445707:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368625920 00000100:00100000:1.0:1788748400.445719:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368625920 00000100:00100000:1.0:1788748400.445809:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:1.0:1788748400.445819:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368625920:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748400.445883:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368625920:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 66us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748400.445891:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00080000:0.0:1788748400.446534:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788748400.932933:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748401.401568:0:13672:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788748401.448933:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748401.452624:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388626688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748401.452724:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748401.461798:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388626688 00000100:00100000:2.0:1788748401.461820:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388626688 00000100:00100000:3.0:1788748401.464978:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788748401.464998:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388626688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788748401.465051:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788748401.465218:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388626688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (12493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748401.465226:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788748401.468243:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388626688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788748401.956532:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788748402.728476:0:13720:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffc4ad710 20000000:00000080:3.0:1788748402.728500:0:13720:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8addb5194c00 uarg=0000000000000000 20000000:01000000:3.0:1788748402.728555:0:13720:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788748402.728564:0:13720:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788748402.728569:0:13720:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788748402.729541:0:13721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788748402.729748:0:13720:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788748402.735459:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788748402.735520:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788748402.735539:0:13720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788748402.735560:0:13720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788748402.735585:0:13720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735607:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735616:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735623:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735631:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735643:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735651:0:13720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735677:0:13720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735728:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735748:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 12 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.735766:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388626816:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748402.735912:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735921:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.735930:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388626944:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748402.735965:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.735973:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 23 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.735982:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627072:0@lo:104: 00000100:00100000:2.0:1788748402.736117:0:13720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748402.736166:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.736188:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 23 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.736197:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627200:0@lo:104: 00010000:00010000:2.0:1788748402.736228:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.736236:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 23 pid: 6502 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.736244:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627328:0@lo:104: 00010000:00010000:2.0:1788748402.736271:0:13720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748402.736279:0:13720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 23 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.736292:0:13720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627456:0@lo:104: 00000100:00100000:2.0:1788748402.736310:0:13720:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86786e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748402.736773:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788748402.736797:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748402.736826:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748402.736834:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748402.736843:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627072 00000100:00100000:1.0:1788748402.736852:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627072 00000100:00100000:1.0:1788748402.736895:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627200 00000100:00100000:1.0:1788748402.736898:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627200 00000100:00100000:1.0:1788748402.736907:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627328 00000100:00100000:1.0:1788748402.736910:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627328 00000100:00100000:1.0:1788748402.736918:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627456 00000100:00100000:1.0:1788748402.736920:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627456 00000100:00100000:1.0:1788748402.736933:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748402.736942:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83809450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:13720:x1875638388627072:12345-0@lo:104: 00010000:00010000:1.0:1788748402.736957:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737014:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748402.737020:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83809450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+6:13720:x1875638388627072:12345-0@lo:104: Request processed in 80us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.737041:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748402.737106:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788748402.737112:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:13720:x1875638388627200:12345-0@lo:104: 00010000:00010000:1.0:1788748402.737121:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737155:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748402.737160:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+5:13720:x1875638388627200:12345-0@lo:104: Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.737166:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788748402.737177:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748402.737183:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:13720:x1875638388627328:12345-0@lo:104: 00010000:00010000:1.0:1788748402.737190:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737222:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788748402.737227:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+4:13720:x1875638388627328:12345-0@lo:104: Request processed in 45us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.737233:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748402.737244:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748402.737249:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:13720:x1875638388627456:12345-0@lo:104: 00010000:00010000:1.0:1788748402.737256:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737282:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788748402.737287:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+3:13720:x1875638388627456:12345-0@lo:104: Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.737293:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788748402.737346:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788748402.737354:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737362:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76000 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748402.737367:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737377:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748402.737386:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748402.737393:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748402.737431:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737439:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748402.737462:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737470:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1a0bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0c2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737485:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748402.737488:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737494:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748402.737496:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737510:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748402.737516:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748402.737521:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748402.737535:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737541:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748402.737548:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737555:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1a0ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0b4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737564:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748402.737567:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737573:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748402.737575:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737582:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748402.737588:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748402.737599:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748402.737612:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737617:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748402.737634:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737642:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d77800/0x9ba0f20a02e1a09f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a0a6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737653:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748402.737656:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737661:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77000 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748402.737664:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737670:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748402.737677:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748402.737683:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748402.737694:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737700:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748402.737712:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737720:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1a091 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1a098 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.737733:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748402.737734:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748402.737736:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748402.737744:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748402.737749:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748402.737781:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388627584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748402.737818:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748402.737848:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748402.737853:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388627712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748402.737872:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748402.737900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388627840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748402.737923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748402.737939:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748402.737944:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388627968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748402.737963:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748402.737993:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627584 00000100:00100000:1.0:1788748402.737999:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627584 00010000:00010000:1.0:1788748402.738022:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 24 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748402.738038:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627712 00000100:00100000:1.0:1788748402.738041:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627712 00010000:00010000:1.0:1788748402.738052:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 25 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748402.738071:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627840 00000100:00100000:1.0:1788748402.738074:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627840 00010000:00010000:1.0:1788748402.738102:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 26 pid: 6502 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748402.738113:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388627968 00000100:00100000:1.0:1788748402.738115:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388627968 00010000:00010000:1.0:1788748402.738125:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 27 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748402.738137:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788748402.738144:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+27:3635:x1875638388627584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748402.738155:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748402.738160:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 27 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738170:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 27 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738191:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748402.738219:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+27:3635:x1875638388627584:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.738226:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788748402.738241:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788748402.738246:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+26:3635:x1875638388627712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748402.738255:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748402.738259:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 26 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738278:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 26 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738288:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748402.738309:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+26:3635:x1875638388627712:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.738338:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788748402.738351:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788748402.738357:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3637:x1875638388627840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748402.738365:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748402.738369:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 25 pid: 6502 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738378:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 25 pid: 6502 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738387:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748402.738411:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+25:3637:x1875638388627840:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.738417:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788748402.738429:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748402.738434:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388627968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748402.738441:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748402.738446:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 24 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738455:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 24 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.738470:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748402.738493:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388627968:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.738500:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748402.738546:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388627968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748402.738556:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388627840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748402.738580:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb537d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388627712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748402.738587:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388627584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748402.738809:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1a0c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0bb expref: 23 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.738823:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627072:0@lo:104: 00010000:00010000:2.0:1788748402.738833:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1a0b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a0ad expref: 22 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.738840:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627200:0@lo:104: 00010000:00010000:2.0:1788748402.738849:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc83a68c00/0x9ba0f20a02e1a0a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a09f expref: 21 pid: 6502 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.738865:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627328:0@lo:104: 00010000:00010000:2.0:1788748402.738877:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1a098 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1a091 expref: 20 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748402.738886:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388627456:0@lo:104: 00000100:00100000:2.0:1788748402.742712:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748402.742747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748402.742895:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388626816:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748402.742910:0:13720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13720:1875638388626944:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748402.742959:0:13720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748402.743811:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626304 00000100:00100000:1.0:1788748402.743823:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626304 00010000:00010000:1.0:1788748402.743873:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 13 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748402.743914:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626432 00000100:00100000:1.0:1788748402.743917:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626432 00010000:00010000:1.0:1788748402.743931:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 14 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748402.743956:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:1.0:1788748402.743967:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ef6cf0-4626-4079-99a4-603102db0d3e+14:2411:x1875638368626304:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748402.743986:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748402.743992:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 14 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744005:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 14 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744051:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a0d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b3d expref: 14 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744068:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748402.744144:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368626304:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 177us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.744153:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:1.0:1788748402.744174:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:1.0:1788748402.744181:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:2411:x1875638368626432:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748402.744189:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748402.744193:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744202:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744214:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a0c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b36 expref: 12 pid: 6503 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744225:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744235:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744508:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744529:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744537:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744545:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744552:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fba00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748402.744557:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744566:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744579:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.744592:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748402.744616:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ef6cf0-4626-4079-99a4-603102db0d3e+11:2411:x1875638368626432:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 435us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748402.744624:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00010000:00010000:0.0:1788748402.744848:0:13720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748402.744859:0:13720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748402.744866:0:13720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813fba00/0x9ba0f20a02e1a204 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748402.761751:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788748402.761790:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788748402.761802:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788748402.761843:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.761855:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.761876:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.761887:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc191c4f0) 00000100:00100000:0.0:1788748402.761890:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788748402.761895:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.761905:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748402.761912:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388628096:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788748402.761942:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff8addb5113d00) 00010000:00010000:1.0:1788748402.761945:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748402.761951:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.761958:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a15c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.761979:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.761986:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748402.761992:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748402.762001:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762009:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748402.762014:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762029:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762038:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8add97552800) 00010000:00010000:1.0:1788748402.762041:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748402.762044:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748402.762048:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628096 00010000:00010000:1.0:1788748402.762053:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a171 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748402.762057:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628096 00010000:00010000:1.0:1788748402.762074:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762091:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762098:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762103:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748402.762106:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762181:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762191:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff8addb5113d00) 00010000:00010000:1.0:1788748402.762193:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748402.762196:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762207:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a1da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762222:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762228:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762235:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762240:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748402.762243:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762248:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762254:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8addba6a9000) 00010000:00010000:1.0:1788748402.762257:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748402.762259:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762265:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a1f6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788748402.762296:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748402.762312:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748402.762347:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388628096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788748402.762397:0:8425:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788748402.762544:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9e226d, atime: 0x6a9e226d, ctime: 0x6a9e226d, blocks: 0x0 00010000:00010000:1.0:1788748402.762559:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762572:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1788748402.762577:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748402.762583:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762647:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762655:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762659:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748402.762674:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748402.762698:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748402.762707:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748402.762717:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748402.762722:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748402.762744:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748402.762762:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748402.762770:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1a20b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748402.762791:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748402.762793:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748402.762795:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748402.762808:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388628096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 464us (819us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788748402.762814:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788748402.762830:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc83b09180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788748402.762839:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388628096:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788748402.988357:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748403.492540:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748403.492576:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388628224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748403.492667:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748403.493032:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628224 00000100:00100000:1.0:1788748403.493042:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628224 00000100:00100000:1.0:1788748403.493116:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788748403.493128:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388628224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748403.493173:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748403.493233:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388628224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748403.493252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788748403.493433:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388628224:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1788748403.734923:0:13769:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce3e5fa50 20000000:00000080:0.0:1788748403.734947:0:13769:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8adc8380a400 uarg=0000000000000000 20000000:01000000:0.0:1788748403.735007:0:13769:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788748403.735016:0:13769:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788748403.735022:0:13769:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788748403.736734:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788748403.736959:0:13769:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788748403.737113:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788748403.737150:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788748403.737165:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788748403.737181:0:13769:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788748403.737207:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737226:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737238:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737245:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737252:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737260:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737283:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813faa00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748403.737287:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737295:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737311:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737351:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748403.737357:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add813faa00/0x9ba0f20a02e1a212 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748404.005938:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748404.005948:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc838be800 from 7 10000000:01000000:1.0:1788748404.005955:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748404.006027:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.006042:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.006056:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748404.006099:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388628352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.006195:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.006285:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748404.008010:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628352 00000100:00100000:0.0:1788748404.008031:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628352 00000100:00100000:0.0:1788748404.008119:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788748404.008131:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:6507:x1875638388628352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748404.008155:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748404.008199:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a220 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a219 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.008245:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a219 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.008259:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a219 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.008270:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940c00, rc 0) 00000100:00100000:0.0:1788748404.008380:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388628352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.008387:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788748404.008683:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748404.008704:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388628480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748404.008775:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.008822:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628480 00000100:00100000:3.0:1788748404.008827:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628480 00000100:00100000:3.0:1788748404.008871:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788748404.008880:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388628480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748404.008908:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748404.008949:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388628480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.008955:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788748404.008974:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788748404.009007:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840b8700 x1875638388628480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748404.009027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388628480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748404.009830:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388628864:0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.009882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.009911:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388629376:0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.009935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.009956:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788748404.009961:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388628736:0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.009986:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.010004:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388629248:0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010025:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.010043:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388629760:0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010065:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.010123:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628736 00000100:00100000:2.0:1788748404.010130:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628736 00000100:00100000:2.0:1788748404.010172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788748404.010180:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388628736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010250:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388628736:12345-0@lo:400:kworker.0 Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.010258:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788748404.010283:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388629376 00000100:00100000:2.0:1788748404.010287:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388629376 00000100:00100000:2.0:1788748404.010348:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388629248 00000100:00100000:2.0:1788748404.010352:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388629248 00000100:00100000:2.0:1788748404.010368:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388629760 00000100:00100000:2.0:1788748404.010371:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388629760 00000100:00100000:2.0:1788748404.010387:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748404.010394:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388629376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010427:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388629376:12345-0@lo:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.010433:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748404.010446:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788748404.010451:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388629248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010479:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388629248:12345-0@lo:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.010484:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788748404.010499:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788748404.010504:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388629760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010530:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388629760:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.010535:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788748404.010582:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388628736:0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010594:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388629248:0@lo:400:kworker.0 00010000:00080000:2.0:1788748404.010605:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408d880 x1875638388629760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748404.010614:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388629760:0@lo:400:kworker.0 00000100:00100000:2.0:1788748404.010623:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388629376:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011131:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628864 00000100:00100000:3.0:1788748404.011140:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628864 00000100:00100000:3.0:1788748404.011187:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788748404.011195:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388628864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011261:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388628864:12345-0@lo:400:kworker.0 Request processed in 66us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.011276:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1788748404.011297:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748404.011301:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748404.011344:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388628608:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011380:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.011406:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388629120:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.011446:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388629632:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011465:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.011488:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788748404.011494:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388628992:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011514:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.011529:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388629504:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.011571:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628608 00000100:00100000:3.0:1788748404.011575:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628608 00000100:00100000:3.0:1788748404.011593:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388629120 00000100:00100000:3.0:1788748404.011596:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388629120 00000100:00100000:3.0:1788748404.011615:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388629632 00000100:00100000:3.0:1788748404.011617:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388629632 00000100:00100000:3.0:1788748404.011627:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388628992 00000100:00100000:3.0:1788748404.011629:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388628992 00000100:00100000:3.0:1788748404.011641:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388629504 00000100:00100000:3.0:1788748404.011643:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388629504 00000100:00100000:3.0:1788748404.011656:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788748404.011662:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388628608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011698:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388628608:12345-0@lo:400:kworker.0 Request processed in 36us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.011712:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788748404.011723:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788748404.011728:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388629120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011755:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388629120:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.011777:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788748404.011789:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788748404.011795:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388629632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011823:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388629632:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.011828:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788748404.011839:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788748404.011844:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388628992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011872:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388628992:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.011878:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788748404.011888:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788748404.011893:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388629504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.011918:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388629504:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.011923:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1788748404.011948:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748404.011952:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748404.011988:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388628864:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.012034:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388628992:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.012044:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388629504:0@lo:400:kworker.0 00000100:00100000:3.0:1788748404.012053:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388628608:0@lo:400:kworker.0 00010000:00080000:3.0:1788748404.012064:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc825c1500 x1875638388629120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748404.012084:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388629120:0@lo:400:kworker.0 00010000:00080000:3.0:1788748404.012093:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408ca80 x1875638388629632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748404.012100:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388629632:0@lo:400:kworker.0 00010000:00010000:1.0:1788748404.014265:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748404.014350:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388628352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748404.014388:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.014403:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748404.014493:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.014567:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.014612:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748404.014751:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630016 00000100:00100000:0.0:1788748404.014771:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630016 00000100:00100000:0.0:1788748404.014831:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788748404.014842:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388630016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748404.015006:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388630016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.015015:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788748404.015054:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788748404.015066:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388629888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748404.015112:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.017948:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.018060:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.018163:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.018210:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748404.018904:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388629888 00000100:00100000:3.0:1788748404.018917:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388629888 00000100:00100000:3.0:1788748404.018999:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788748404.019010:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388629888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748404.019040:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748404.019134:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388629888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.019142:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788748404.019347:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630144 00000100:00100000:0.0:1788748404.019353:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630144 00000100:00100000:0.0:1788748404.019397:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788748404.019406:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388630144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748404.019547:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388630144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.019562:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00080000:1.0:1788748404.019734:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf49c380 x1875638388629888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748404.019772:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388629888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748404.019813:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.021386:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13782:1875638388630272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748404.021486:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.021537:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748404.021668:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630272 00000100:00100000:0.0:1788748404.021678:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630272 00000100:00100000:0.0:1788748404.021742:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788748404.021752:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:13782:x1875638388630272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748404.021915:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:13782:x1875638388630272:12345-0@lo:502:llog_process_th.0 Request processed in 164us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.021924:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788748404.022104:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13782:1875638388630272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748404.022139:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.022152:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.022154:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.022162:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc838be800 00000020:00000080:1.0:1788748404.022165:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748404.022880:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748404.022893:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.022895:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.022898:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.022902:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.022903:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788748404.022906:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc838be800 00000020:00000080:1.0:1788748404.022909:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788748404.034292:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13782:1875638388630400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748404.034413:0:13782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.034497:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096900 going to sleep for 11 seconds 00000100:00100000:3.0:1788748404.034851:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630400 00000100:00100000:3.0:1788748404.034862:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630400 00000100:00100000:3.0:1788748404.034985:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788748404.034999:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:13782:x1875638388630400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748404.035195:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:13782:x1875638388630400:12345-0@lo:502:llog_process_th.0 Request processed in 199us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.035215:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788748404.035409:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13782:1875638388630400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748404.035449:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748404.035459:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.035462:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788748404.035467:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788748404.035639:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788748404.035679:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748404.035692:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.035705:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748404.035716:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748404.035719:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8addb53d9000 from 7 10000000:01000000:1.0:1788748404.035722:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748404.035895:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.035906:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.035918:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748404.035942:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.035992:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.036089:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096900 going to sleep for 11 seconds 00000100:00100000:3.0:1788748404.036312:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630528 00000100:00100000:3.0:1788748404.036362:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630528 00000100:00100000:3.0:1788748404.036403:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788748404.036413:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:6507:x1875638388630528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748404.036426:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748404.036442:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e1a22e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a227 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.036472:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e1a22e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a227 expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.036485:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e1a22e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a227 expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.036494:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76600, rc 0) 00000100:00100000:3.0:1788748404.036537:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388630528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.036545:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788748404.036685:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748404.036703:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.036714:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748404.036863:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748404.036900:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.036933:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3b95600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748404.036981:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630656 00000100:00100000:3.0:1788748404.036985:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630656 00000100:00100000:3.0:1788748404.037051:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788748404.037060:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388630656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748404.037207:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388630656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.037214:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788748404.037356:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.037409:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.037457:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.037601:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.037639:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630784 00000100:00100000:2.0:1788748404.037643:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630784 00000100:00100000:2.0:1788748404.037668:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788748404.037675:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388630784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748404.037773:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388630784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.037780:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788748404.037951:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388630784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748404.038472:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13784:1875638388630912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748404.038529:0:13784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.038598:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc841450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.038632:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388630912 00000100:00100000:2.0:1788748404.038638:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388630912 00000100:00100000:2.0:1788748404.038712:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788748404.038721:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:13784:x1875638388630912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748404.038844:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:13784:x1875638388630912:12345-0@lo:502:llog_process_th.0 Request processed in 124us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.038852:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788748404.038981:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13784:1875638388630912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748404.039012:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.039024:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.039027:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.039034:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8addb53d9000 00000020:00000080:1.0:1788748404.039036:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748404.039121:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748404.039125:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.039126:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.039129:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.039132:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.039133:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788748404.039136:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8addb53d9000 00000020:00000080:1.0:1788748404.039138:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788748404.039173:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13784:1875638388631040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748404.039211:0:13784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.039400:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631040 00000100:00100000:3.0:1788748404.039406:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631040 00000100:00100000:3.0:1788748404.039435:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788748404.039443:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:13784:x1875638388631040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748404.039522:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:13784:x1875638388631040:12345-0@lo:502:llog_process_th.0 Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.039530:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788748404.040504:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748404.040537:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13784:1875638388631040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748404.040573:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748404.040582:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.040583:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788748404.040588:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788748404.040865:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788748404.040893:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748404.040905:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.040919:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748404.040932:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748404.040935:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add8f106000 from 7 10000000:01000000:2.0:1788748404.040938:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748404.040975:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.040983:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.040994:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748404.041017:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748404.041084:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.041119:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3b95f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748404.041400:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631168 00000100:00100000:3.0:1788748404.041408:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631168 00000100:00100000:3.0:1788748404.041448:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788748404.041457:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:6507:x1875638388631168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748404.041472:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748404.041488:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a23c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a235 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.041517:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a23c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a235 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.041529:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a23c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a235 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.041539:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76c00, rc 0) 00000100:00100000:3.0:1788748404.041592:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388631168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.041599:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788748404.041710:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748404.041739:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748404.041749:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748404.041888:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.041922:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.041959:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.042004:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631296 00000100:00100000:2.0:1788748404.042015:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631296 00000100:00100000:2.0:1788748404.042047:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788748404.042054:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388631296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748404.042198:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388631296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.042206:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788748404.042397:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.042431:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.042478:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.042579:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84096300 going to sleep for 11 seconds 00000100:00100000:3.0:1788748404.042612:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631424 00000100:00100000:3.0:1788748404.042625:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631424 00000100:00100000:3.0:1788748404.042699:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788748404.042708:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388631424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748404.042926:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388631424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.042933:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788748404.042990:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.043478:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13785:1875638388631552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748404.043524:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.043552:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc840963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.043605:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631552 00000100:00100000:2.0:1788748404.043611:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631552 00000100:00100000:2.0:1788748404.043645:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788748404.043653:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:13785:x1875638388631552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748404.043746:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:13785:x1875638388631552:12345-0@lo:502:llog_process_th.0 Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.043753:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788748404.043896:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13785:1875638388631552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748404.043918:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.043928:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.043931:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.043938:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8add8f106000 00000020:00000080:1.0:1788748404.043941:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748404.044015:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748404.044019:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.044020:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.044029:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.044032:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.044034:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788748404.044037:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8add8f106000 00000020:00000080:1.0:1788748404.044039:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788748404.044085:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13785:1875638388631680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748404.044124:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748404.044151:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc840963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.044677:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631680 00000100:00100000:2.0:1788748404.044685:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631680 00000100:00100000:2.0:1788748404.044722:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788748404.044731:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:13785:x1875638388631680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748404.046204:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13785:1875638388631680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748404.046387:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:13785:x1875638388631680:12345-0@lo:502:llog_process_th.0 Request processed in 1315us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.046398:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000020:01000000:3.0:1788748404.046510:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748404.046520:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748404.046522:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788748404.046531:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788748404.046731:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788748404.047134:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748404.047149:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.047164:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748404.047187:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748404.047191:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adda7357000 from 7 10000000:01000000:2.0:1788748404.047194:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748404.047399:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.047409:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.047420:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748404.047450:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748404.047515:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.047573:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add82fb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748404.047866:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631808 00000100:00100000:0.0:1788748404.047875:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631808 00000100:00100000:0.0:1788748404.047929:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788748404.047939:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:6507:x1875638388631808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748404.047955:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748404.047969:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1a24a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1a243 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.047996:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1a24a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a243 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.048008:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1a24a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1a243 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.048017:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940600, rc 0) 00000100:00100000:0.0:1788748404.048940:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388631808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 996us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.048952:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788748404.049148:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748404.049174:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748404.049187:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748404.049959:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748404.050024:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.050160:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc841450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.050228:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388631936 00000100:00100000:2.0:1788748404.050305:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388631936 00000100:00100000:2.0:1788748404.050390:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788748404.050400:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388631936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748404.050566:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388631936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.050587:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788748404.050942:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388631936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748404.050999:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388632064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748404.051307:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748404.051368:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc840ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788748404.051863:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632064 00000100:00100000:2.0:1788748404.051872:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632064 00000100:00100000:2.0:1788748404.053371:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788748404.053390:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388632064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748404.053574:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:6507:x1875638388632064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.053583:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788748404.053727:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:27ab3bfa-63dd-419e-978e-87fcee7a537d:6507:1875638388632064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788748404.061573:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788748404.070979:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13787:1875638388632192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748404.071939:0:13787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748404.072016:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84145600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748404.072146:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632192 00000100:00100000:0.0:1788748404.072156:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632192 00000100:00100000:0.0:1788748404.072221:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788748404.072857:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:13787:x1875638388632192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748404.074719:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:13787:x1875638388632192:12345-0@lo:502:llog_process_th.0 Request processed in 2478us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.074737:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000040:00080000:2.0:1788748404.080503:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788748404.083211:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13787:1875638388632192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788748404.083289:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.083306:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.083308:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.083337:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adda7357000 00000020:00000080:1.0:1788748404.083340:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748404.083426:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748404.085674:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.085683:0:13787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748404.085696:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748404.085704:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748404.085705:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788748404.085711:0:13787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adda7357000 00000020:00000080:1.0:1788748404.085714:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788748404.087206:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13787:1875638388632320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748404.088682:0:13787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748404.088748:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc840966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748404.098699:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632320 00000100:00100000:0.0:1788748404.098717:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632320 00000100:00100000:0.0:1788748404.099194:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788748404.099207:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:13787:x1875638388632320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748404.099420:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:13787:x1875638388632320:12345-0@lo:502:llog_process_th.0 Request processed in 216us (10744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.099428:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788748404.101523:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:27ab3bfa-63dd-419e-978e-87fcee7a537d:13787:1875638388632320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748404.101585:0:13787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748404.101597:0:13787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748404.101600:0:13787:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788748404.101604:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788748404.105658:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788748404.105705:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748404.105719:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.105735:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748404.151974:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748404.152106:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626560 00000100:00100000:0.0:1788748404.152120:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626560 00000100:00100000:0.0:1788748404.152189:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 356 00000100:00100000:0.0:1788748404.152201:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+11:6183:x1875638368626560:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748404.152222:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748404.152245:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1a251 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b8a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.152293:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1a251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b8a expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.152305:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1a251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b8a expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748404.152340:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940e00, rc 0) 00000100:00100000:0.0:1788748404.152412:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368626560:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 212us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.152419:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 356 00000100:00100000:1.0:1788748404.156898:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748404.160407:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626688 00000100:00100000:0.0:1788748404.160429:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626688 00000100:00100000:0.0:1788748404.160494:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 357 00000100:00100000:0.0:1788748404.160506:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368626688:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748404.160711:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368626688:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 207us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.160719:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 357 00000100:00100000:0.0:1788748404.166548:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748404.166668:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626816 00000100:00100000:3.0:1788748404.166681:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626816 00000100:00100000:3.0:1788748404.166782:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 358 00000100:00100000:3.0:1788748404.166794:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368626816:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748404.167000:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368626816:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 206us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.167009:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 358 00000100:00100000:0.0:1788748404.174410:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748404.174512:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368626944 00000100:00100000:3.0:1788748404.174526:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368626944 00000100:00100000:3.0:1788748404.174650:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 359 00000100:00100000:3.0:1788748404.174664:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:10789:x1875638368626944:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748404.175038:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:10789:x1875638368626944:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 375us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.175048:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 359 00000100:00100000:2.0:1788748404.178682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748404.178781:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627072 00000100:00100000:3.0:1788748404.178796:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627072 00000100:00100000:3.0:1788748404.178873:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 360 00000100:00100000:3.0:1788748404.178886:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+12:10789:x1875638368627072:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748404.179164:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+12:10789:x1875638368627072:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 280us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.179174:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 360 00000100:00100000:2.0:1788748404.190569:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748404.195125:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627200 00000100:00100000:3.0:1788748404.195148:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627200 00000100:00100000:3.0:1788748404.195241:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 361 00000100:00100000:3.0:1788748404.195255:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+12:6183:x1875638368627200:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748404.195306:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748404.195351:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a258 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b91 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.195389:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b91 expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.195402:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b91 expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748404.195413:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76200, rc 0) 00000100:00100000:3.0:1788748404.195502:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368627200:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 250us (4947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.195510:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 361 00000100:00100000:0.0:1788748404.208241:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748404.208352:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627328 00000100:00100000:1.0:1788748404.208366:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627328 00000100:00100000:1.0:1788748404.208511:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 362 00000100:00100000:1.0:1788748404.208524:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368627328:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748404.208732:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368627328:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 200us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748404.208750:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 362 00000100:00100000:1.0:1788748404.216220:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748404.217416:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627456 00000100:00100000:3.0:1788748404.217434:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627456 00000100:00100000:3.0:1788748404.217510:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 363 00000100:00100000:3.0:1788748404.217523:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368627456:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748404.217685:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:6183:x1875638368627456:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 164us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748404.217695:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 363 00000100:00100000:0.0:1788748404.221985:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748404.222054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627584 00000100:00100000:1.0:1788748404.222080:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627584 00000100:00100000:1.0:1788748404.222144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 364 00000100:00100000:1.0:1788748404.222154:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:10793:x1875638368627584:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748404.222343:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:10793:x1875638368627584:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 161us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748404.222352:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 364 00000100:00100000:0.0:1788748404.233078:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748404.237139:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627712 00000100:00100000:1.0:1788748404.237158:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627712 00000100:00100000:1.0:1788748404.237243:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 365 00000100:00100000:1.0:1788748404.237255:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:10793:x1875638368627712:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748404.237476:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:10793:x1875638368627712:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 221us (4419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748404.237485:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 365 00000100:00100000:3.0:1788748404.518239:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748404.518268:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388632448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748404.518387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748404.518639:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632448 00000100:00100000:0.0:1788748404.518651:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632448 00000100:00100000:0.0:1788748404.518715:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788748404.518728:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388632448:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748404.518733:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388632576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748404.518771:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788748404.518791:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748404.518851:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388632448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748404.518859:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788748404.518908:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388632448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748404.519205:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632576 00000100:00100000:2.0:1788748404.519211:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632576 00000100:00100000:2.0:1788748404.519251:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788748404.519261:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388632576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748404.519274:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748404.519349:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388632576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748404.519364:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788748404.519544:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388632576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788748405.029578:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748405.096850:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788748405.097863:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788748405.561690:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748405.561756:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748405.561795:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748405.561838:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748405.561883:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748405.561993:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748405.562047:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628224 00000100:00100000:0.0:1788748405.562068:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628224 00000100:00100000:0.0:1788748405.562150:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:0.0:1788748405.562162:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368628224:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748405.562255:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368628224:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 96us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748405.562263:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:0.0:1788748405.562291:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627840 00000100:00100000:0.0:1788748405.562294:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627840 00000100:00100000:0.0:1788748405.562359:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 366 00000100:00100000:0.0:1788748405.562367:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368627840:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748405.562393:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368627840:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748405.562400:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 366 00000100:00100000:3.0:1788748405.570106:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368627968 00000100:00100000:3.0:1788748405.570121:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368627968 00000100:00100000:3.0:1788748405.570200:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628480 00000100:00100000:3.0:1788748405.570204:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628480 00000100:00100000:3.0:1788748405.570229:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628096 00000100:00100000:3.0:1788748405.570232:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628096 00000100:00100000:3.0:1788748405.570254:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:3.0:1788748405.570263:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368627968:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748405.572008:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368627968:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1740us (10325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748405.572021:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:3.0:1788748405.572054:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:3.0:1788748405.572073:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368628480:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748405.572100:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368628480:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (10304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748405.572106:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:3.0:1788748405.572119:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1788748405.572126:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368628096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748405.572153:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368628096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (10271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748405.572159:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00080000:3.0:1788748405.572182:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748405.572187:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748405.572190:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748405.573773:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628352 00000100:00100000:1.0:1788748405.573785:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628352 00000100:00100000:1.0:1788748405.573857:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:1.0:1788748405.573867:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368628352:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748405.573926:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368628352:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 61us (11932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748405.573933:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00080000:2.0:1788748405.574349:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788748406.053804:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748406.564652:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388632704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748406.564727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748406.565038:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632704 00000100:00100000:3.0:1788748406.565046:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632704 00000100:00100000:3.0:1788748406.565114:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788748406.565124:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388632704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788748406.565174:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788748406.565243:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388632704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748406.565250:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788748406.565445:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388632704:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788748407.077026:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748408.103714:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748408.613989:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388632832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748408.614072:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748408.614823:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632832 00000100:00100000:1.0:1788748408.614832:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632832 00000100:00100000:1.0:1788748408.614885:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788748408.614893:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388632832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748408.614928:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748408.614995:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388632832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748408.615002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788748408.615097:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388632832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748409.124602:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748409.124629:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388632960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748409.124705:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748409.124756:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388632960 00000100:00100000:1.0:1788748409.124765:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388632960 00000100:00080000:0.0:1788748409.124811:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748409.124826:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788748409.124837:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388632960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748409.124873:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748409.125489:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388633216:0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.125610:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388633344:0@lo:400:kworker.0 00010000:00010000:3.0:1788748409.126164:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748409.126187:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388633088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748409.130248:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748409.130304:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388633728:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.130363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748409.130382:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388634240:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.130405:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748409.130452:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633216 00000100:00100000:0.0:1788748409.130460:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633216 00000100:00100000:0.0:1788748409.130501:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788748409.130509:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388633216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.130721:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388633216:12345-0@lo:400:kworker.0 Request processed in 211us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.130728:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788748409.130764:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388634240 00000100:00100000:0.0:1788748409.130768:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388634240 00000100:00100000:0.0:1788748409.130799:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788748409.130805:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388634240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.130837:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388634240:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.130843:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788748409.130865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633728 00000100:00100000:0.0:1788748409.130868:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633728 00000100:00100000:0.0:1788748409.130901:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788748409.130907:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388633728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.130938:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388633728:12345-0@lo:400:kworker.0 Request processed in 31us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.130959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788748409.130979:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748409.131003:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388633216:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131016:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388633728:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131025:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388634240:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131075:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388633472:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131100:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748409.131119:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388633984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748409.131160:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388634496:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131178:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748409.131205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633472 00000100:00100000:0.0:1788748409.131208:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633472 00000100:00100000:0.0:1788748409.131230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788748409.131235:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388633472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131266:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388633472:12345-0@lo:400:kworker.0 Request processed in 31us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.131271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788748409.131295:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388633472:0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131310:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633984 00000100:00100000:0.0:1788748409.131313:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633984 00000100:00100000:0.0:1788748409.131358:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388634496 00000100:00100000:0.0:1788748409.131362:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388634496 00000100:00100000:0.0:1788748409.131381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788748409.131393:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131426:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388633984:12345-0@lo:400:kworker.0 Request processed in 34us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.131432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788748409.131443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788748409.131449:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388634496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748409.131474:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388634496:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748409.131480:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1788748409.131493:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788748409.131510:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a2d80 x1875638388633984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748409.131520:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388633984:0@lo:400:kworker.0 00010000:00080000:0.0:1788748409.131529:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a2a00 x1875638388634496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748409.131536:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388634496:0@lo:400:kworker.0 00000100:00100000:1.0:1788748409.131562:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388632960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6725us (6854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.131572:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788748409.132111:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.132136:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388633856:0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.132159:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.132177:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388634368:0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.132196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748409.132226:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633344 00000100:00100000:2.0:1788748409.132231:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633344 00000100:00100000:2.0:1788748409.132255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633856 00000100:00100000:2.0:1788748409.132258:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633856 00000100:00100000:2.0:1788748409.132279:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388634368 00000100:00100000:2.0:1788748409.132282:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388634368 00000100:00100000:2.0:1788748409.132297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788748409.132303:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388633344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.132368:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388633344:12345-0@lo:400:kworker.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.132375:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788748409.132389:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788748409.132394:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388633856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.132418:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388633856:12345-0@lo:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.132424:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788748409.132434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788748409.132440:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388634368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.132463:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388634368:12345-0@lo:400:kworker.0 Request processed in 24us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.132468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:2.0:1788748409.132483:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748409.132505:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388633344:0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.132514:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388633856:0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.132521:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388634368:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.134497:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748409.134548:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388633600:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.134581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748409.134605:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388634112:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.134628:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748409.134647:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388634624:0@lo:400:kworker.0 00000100:00100000:3.0:1788748409.134664:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748409.134806:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633088 00000100:00100000:1.0:1788748409.134814:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633088 00000100:00100000:1.0:1788748409.134877:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788748409.134887:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388633088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748409.134919:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748409.134961:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388633088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.134982:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788748409.135251:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c3b80 x1875638388632960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748409.135271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388632960:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788748409.135298:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8408ca80 x1875638388633088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748409.135310:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388633088:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788748409.135554:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748409.135577:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388633600 00000100:00100000:2.0:1788748409.135582:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388633600 00000100:00100000:2.0:1788748409.135722:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788748409.135741:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388633600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748409.135796:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388633600:12345-0@lo:400:kworker.0 Request processed in 58us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748409.135814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788748409.135946:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388633600:0@lo:400:kworker.0 00000001:00080000:2.0:1788748409.137052:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788748409.141347:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388634112 00000100:00100000:1.0:1788748409.141362:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388634112 00000100:00100000:1.0:1788748409.141518:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388634624 00000100:00100000:1.0:1788748409.141522:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388634624 00000100:00100000:1.0:1788748409.141553:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788748409.141563:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388634112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748409.141659:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388634112:12345-0@lo:400:kworker.0 Request processed in 98us (7030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.141667:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788748409.141684:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788748409.141691:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388634624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748409.141724:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388634624:12345-0@lo:400:kworker.0 Request processed in 34us (7059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.141730:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788748409.141779:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388634112:0@lo:400:kworker.0 00010000:00080000:1.0:1788748409.141794:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a3480 x1875638388634624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748409.141805:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388634624:0@lo:400:kworker.0 00000100:00080000:2.0:1788748409.142587:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748409.636630:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748409.636653:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388634752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748409.636722:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748409.636931:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388634752 00000100:00100000:1.0:1788748409.636940:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388634752 00000100:00100000:1.0:1788748409.636992:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788748409.637001:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388634752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748409.637042:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748409.637092:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388634752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748409.637114:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788748409.637162:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788748409.637168:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc83b09180, transno 4294967301 00000100:00100000:1.0:1788748409.637183:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388634752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748409.637523:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388634880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748409.637555:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748409.637641:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388634880 00000100:00100000:3.0:1788748409.637646:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388634880 00000100:00100000:3.0:1788748409.637687:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788748409.637694:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388634880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748409.637706:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748409.637737:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388634880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748409.637744:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788748409.637808:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388634880:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788748410.148691:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748410.678464:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748410.678519:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748410.678568:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748410.678600:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628608 00000100:00100000:0.0:1788748410.678613:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748410.678618:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628608 00000100:00100000:0.0:1788748410.678646:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748410.678709:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 368 00000100:00100000:1.0:1788748410.678722:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368628608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748410.678804:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368628608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748410.678811:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 368 00000100:00100000:1.0:1788748410.678847:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628736 00000100:00100000:1.0:1788748410.678851:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628736 00000100:00100000:1.0:1788748410.678884:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368629248 00000100:00100000:1.0:1788748410.678887:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368629248 00000100:00100000:1.0:1788748410.678905:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628864 00000100:00100000:1.0:1788748410.678907:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628864 00000100:00100000:3.0:1788748410.678932:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368628992 00000100:00100000:1.0:1788748410.678940:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:3.0:1788748410.678945:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368628992 00000100:00100000:1.0:1788748410.678951:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368628736:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748410.678992:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368628736:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748410.678999:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:1.0:1788748410.679019:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:3.0:1788748410.679039:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:1.0:1788748410.679046:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368629248:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748410.679057:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368628992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748410.679104:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368629248:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 62us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748410.679111:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:3.0:1788748410.679133:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368628992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748410.679134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:3.0:1788748410.679158:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:1.0:1788748410.679159:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368628864:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748410.679199:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368628864:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 52us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748410.679205:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00080000:1.0:1788748410.679248:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748410.679254:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748410.679256:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748410.679708:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748410.680221:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368629120 00000100:00100000:2.0:1788748410.680230:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368629120 00000100:00100000:2.0:1788748410.680309:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:2.0:1788748410.680343:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368629120:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748410.680402:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368629120:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748410.680420:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00080000:3.0:1788748410.680542:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788748411.175780:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748411.685655:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388635008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748411.685754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748411.685916:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635008 00000100:00100000:1.0:1788748411.685927:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635008 00000100:00100000:1.0:1788748411.686005:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788748411.686027:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388635008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748411.686073:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788748411.688882:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388635008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2854us (3115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748411.688899:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788748411.689088:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388635008:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788748412.196961:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748413.221272:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748413.733711:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388635136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748413.733834:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748413.733917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635136 00000100:00100000:3.0:1788748413.733929:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635136 00000100:00100000:3.0:1788748413.734014:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788748413.734027:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388635136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788748413.734072:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748413.734139:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388635136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748413.734147:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788748413.734550:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388635136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748414.250644:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388635648:0@lo:400:kworker.0 00000100:00100000:0.0:1788748414.250730:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388635392:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.250739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748414.250774:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748414.250807:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388635520:0@lo:400:kworker.0 00000100:00100000:0.0:1788748414.250835:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748414.252048:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388636160:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.252116:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748414.252168:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388636672:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.252196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.254055:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388635264:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.254140:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748414.254205:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636160 00000100:00100000:3.0:1788748414.254218:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636160 00000100:00100000:2.0:1788748414.254278:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388635776:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.254292:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636672 00000100:00100000:3.0:1788748414.254296:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636672 00000100:00100000:2.0:1788748414.254341:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748414.254350:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788748414.254363:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388636160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.254374:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388636288:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.254404:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.254419:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388636800:0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.254460:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388636160:12345-0@lo:400:kworker.0 Request processed in 98us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.254460:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748414.254473:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788748414.254494:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636288 00000100:00100000:3.0:1788748414.254498:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636288 00000100:00100000:2.0:1788748414.254502:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635648 00000100:00100000:2.0:1788748414.254508:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635648 00000100:00100000:3.0:1788748414.254517:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636800 00000100:00100000:3.0:1788748414.254521:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636800 00000100:00100000:3.0:1788748414.254544:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788748414.254548:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635392 00000100:00100000:3.0:1788748414.254551:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388636672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.254561:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635392 00000100:00100000:3.0:1788748414.254593:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388636672:12345-0@lo:400:kworker.0 Request processed in 41us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.254594:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788748414.254606:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788748414.254608:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388635648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.254624:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788748414.254632:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388636288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.254656:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388635648:12345-0@lo:400:kworker.0 Request processed in 50us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.254664:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788748414.254681:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388636288:12345-0@lo:400:kworker.0 Request processed in 49us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.254686:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788748414.254695:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788748414.254700:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388635392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.254714:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788748414.254722:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbcacf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388636800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748414.254749:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbcacf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388636800:12345-0@lo:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748414.254755:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788748414.254946:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635520 00000100:00100000:1.0:1788748414.254951:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635520 00000100:00100000:1.0:1788748414.254982:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635776 00000100:00100000:1.0:1788748414.254985:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635776 00000100:00100000:1.0:1788748414.255009:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788748414.255018:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388635520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255039:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388635392:12345-0@lo:400:kworker.0 Request processed in 342us (4263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.255048:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788748414.255076:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388635520:12345-0@lo:400:kworker.0 Request processed in 59us (4238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748414.255084:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788748414.255103:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788748414.255110:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388635776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255136:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635264 00000100:00100000:2.0:1788748414.255142:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635264 00000100:00100000:1.0:1788748414.255147:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388635776:12345-0@lo:400:kworker.0 Request processed in 37us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748414.255155:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788748414.255205:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388636160:0@lo:400:kworker.0 00010000:00080000:1.0:1788748414.255221:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb392b480 x1875638388636672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748414.255231:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388636672:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255247:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788748414.255248:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388635648:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255262:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388635264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.255306:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388635520:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255350:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388635264:12345-0@lo:400:kworker.0 Request processed in 91us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.255358:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788748414.255390:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388636032:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255411:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388635264:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255427:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388635776:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.255433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.255443:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388636288:0@lo:400:kworker.0 00010000:00080000:2.0:1788748414.255456:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb392a680 x1875638388636800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748414.255468:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388636800:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.255471:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388636544:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.255500:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.255505:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748414.255516:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388636928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748414.255550:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748414.255555:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388635392:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.255566:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388635904:0@lo:400:kworker.0 00000100:00100000:1.0:1788748414.255596:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.255597:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636032 00000100:00100000:2.0:1788748414.255603:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636032 00000100:00100000:1.0:1788748414.255620:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388636416:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.255638:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636544 00000100:00100000:2.0:1788748414.255643:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636544 00000100:00100000:1.0:1788748414.255648:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.255663:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388635904 00000100:00100000:2.0:1788748414.255667:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388635904 00000100:00100000:2.0:1788748414.255685:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636416 00000100:00100000:2.0:1788748414.255687:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636416 00000100:00100000:2.0:1788748414.255704:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788748414.255963:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388636032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.256025:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388636032:12345-0@lo:400:kworker.0 Request processed in 315us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.256032:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788748414.256047:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788748414.256054:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388636544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.256086:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388636544:12345-0@lo:400:kworker.0 Request processed in 33us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.256093:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788748414.256109:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788748414.256115:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388635904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.256151:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388635904:12345-0@lo:400:kworker.0 Request processed in 36us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.256158:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788748414.256439:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788748414.256457:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388636416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.256495:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388636416:12345-0@lo:400:kworker.0 Request processed in 41us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.256504:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788748414.256536:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388636928 00000100:00100000:2.0:1788748414.256541:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388636928 00000100:00100000:2.0:1788748414.256575:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788748414.256585:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388636928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748414.256613:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748414.256655:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388636928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.256663:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788748414.257705:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748414.257714:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748414.257717:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748414.257720:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748414.257757:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748414.257802:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388637056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748414.257926:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748414.257977:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637056 00000100:00100000:3.0:1788748414.257985:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637056 00000100:00100000:3.0:1788748414.258169:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788748414.258179:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388637056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748414.258202:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748414.258247:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388637056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748414.258254:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788748414.258289:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c1500 x1875638388637056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748414.258310:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388637056:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788748414.258824:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a1880 x1875638388636032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748414.258841:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388636032:0@lo:400:kworker.0 00010000:00080000:2.0:1788748414.258869:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3928a80 x1875638388636544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748414.258879:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388636544:0@lo:400:kworker.0 00010000:00080000:2.0:1788748414.258931:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc825c0000 x1875638388636928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748414.258947:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388636928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748414.258993:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388635904:0@lo:400:kworker.0 00000100:00100000:2.0:1788748414.259020:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388636416:0@lo:400:kworker.0 00010000:00010000:2.0:1788748414.259163:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748414.756852:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388637184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748414.756962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748414.757221:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637184 00000100:00100000:0.0:1788748414.757234:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637184 00000100:00100000:0.0:1788748414.757305:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748414.757355:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388637184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748414.757398:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748414.757471:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388637184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748414.757478:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788748414.757629:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388637184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748414.757823:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748414.758575:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388637312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748414.758644:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748414.758758:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637312 00000100:00100000:2.0:1788748414.758768:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637312 00000100:00100000:2.0:1788748414.758818:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788748414.758828:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388637312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748414.758851:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748414.758917:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388637312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748414.758925:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788748414.758986:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388637312:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788748415.271386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748415.333679:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788748415.334863:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788748415.799863:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748415.799910:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748415.799935:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748415.799956:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748415.799976:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748415.800028:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748415.800065:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368629632 00000100:00100000:2.0:1788748415.800077:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368629632 00000100:00100000:2.0:1788748415.800147:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368629888 00000100:00100000:2.0:1788748415.800155:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368629888 00000100:00100000:2.0:1788748415.800172:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368629504 00000100:00100000:2.0:1788748415.800175:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368629504 00000100:00100000:2.0:1788748415.800193:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630016 00000100:00100000:2.0:1788748415.800196:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630016 00000100:00100000:2.0:1788748415.800219:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:2.0:1788748415.800230:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368629632:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748415.800352:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368629632:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 123us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748415.800377:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:2.0:1788748415.800403:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:2.0:1788748415.800411:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368629888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748415.800442:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368629888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 32us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748415.800449:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:2.0:1788748415.800465:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:2.0:1788748415.800474:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368629504:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748415.800619:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368629376 00000100:00100000:3.0:1788748415.800624:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368629376 00000100:00100000:3.0:1788748415.800657:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 370 00000100:00100000:3.0:1788748415.800785:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368629376:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748415.800819:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368629376:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748415.800825:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 370 00000100:00080000:3.0:1788748415.800857:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748415.800863:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748415.800909:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368629760 00000100:00100000:3.0:1788748415.800913:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368629760 00000100:00100000:3.0:1788748415.800950:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:3.0:1788748415.800961:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368629760:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748415.801008:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368629760:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 47us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748415.801016:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:3.0:1788748415.801039:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:3.0:1788748415.801046:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368630016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748415.801070:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368630016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748415.801076:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00080000:3.0:1788748415.801096:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748415.801619:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368629504:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1144us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748415.801628:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 229 00010000:00010000:1.0:1788748416.296917:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748416.805018:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388637440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748416.805088:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748416.805154:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637440 00000100:00100000:2.0:1788748416.805170:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637440 00000100:00100000:2.0:1788748416.805251:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788748416.805262:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388637440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748416.805369:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788748416.805470:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388637440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 210us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748416.805477:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788748416.805702:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388637440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748417.316917:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748418.340623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748418.855474:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388637568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748418.855560:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748418.858994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637568 00000100:00100000:3.0:1788748418.859009:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637568 00000100:00100000:3.0:1788748418.859090:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788748418.859100:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388637568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788748418.859141:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748418.859244:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388637568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748418.859251:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788748418.859608:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388637568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788748419.364788:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748419.364949:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388637824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748419.365041:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.368832:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637824 00000100:00100000:2.0:1788748419.368864:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637824 00000100:00100000:2.0:1788748419.368950:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788748419.368963:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388637824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748419.369011:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748419.369097:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388637824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (4056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748419.369103:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1788748419.369155:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf485f80 x1875638388637824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748419.369174:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388637824:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788748419.369431:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748419.369858:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388637696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748419.369909:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748419.370153:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637696 00000100:00100000:3.0:1788748419.370159:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637696 00000100:00100000:3.0:1788748419.370212:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788748419.370220:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388637696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748419.370237:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748419.370292:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388637696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748419.370299:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1788748419.370361:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c2680 x1875638388637696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748419.370377:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388637696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748419.371614:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388638080:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.371682:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.371715:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388638592:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.371736:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.371755:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388639104:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.371788:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.371820:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788748419.371826:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388638208:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.371848:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.371866:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388638720:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.371886:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.371900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388639232:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.371918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748419.371955:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638080 00000100:00100000:1.0:1788748419.371961:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638080 00000100:00100000:1.0:1788748419.372009:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638592 00000100:00100000:1.0:1788748419.372013:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638592 00000100:00100000:1.0:1788748419.372029:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388639104 00000100:00100000:1.0:1788748419.372031:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388639104 00000100:00100000:1.0:1788748419.372042:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638720 00000100:00100000:1.0:1788748419.372045:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638720 00000100:00100000:1.0:1788748419.372054:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388639232 00000100:00100000:1.0:1788748419.372056:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388639232 00000100:00100000:1.0:1788748419.372070:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788748419.372077:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388638080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.372121:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388638080:12345-0@lo:400:kworker.0 Request processed in 44us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748419.372127:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788748419.372141:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788748419.372147:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388638592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.372171:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388638592:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748419.372177:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788748419.372197:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788748419.372203:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388639104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.372231:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388639104:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748419.372236:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788748419.372248:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788748419.372253:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388638720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.372277:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388638720:12345-0@lo:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748419.372283:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788748419.372293:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788748419.372299:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388639232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.372846:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638208 00000100:00100000:2.0:1788748419.372853:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638208 00000100:00100000:2.0:1788748419.372883:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788748419.372891:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388638208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.372946:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388638208:12345-0@lo:400:kworker.0 Request processed in 55us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748419.372952:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788748419.372982:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388637952:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.373055:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388638464:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373075:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.373089:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388638976:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.373134:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788748419.373139:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388638336:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373169:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.373182:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388638848:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373197:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.373218:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388637952 00000100:00100000:2.0:1788748419.373221:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388637952 00000100:00100000:2.0:1788748419.373241:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788748419.373246:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388637952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373273:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388637952:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748419.373279:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788748419.373300:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638464 00000100:00100000:2.0:1788748419.373303:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638464 00000100:00100000:2.0:1788748419.373513:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788748419.373522:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388638464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373554:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388638464:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748419.373560:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788748419.373577:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638336 00000100:00100000:2.0:1788748419.373580:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638336 00000100:00100000:2.0:1788748419.373602:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788748419.373608:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388638336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.373636:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388638336:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748419.373642:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788748419.374509:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388638336:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.374521:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388637952:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.374544:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388638464:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.374599:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388638208:0@lo:400:kworker.0 00010000:00080000:2.0:1788748419.374612:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380dc00 x1875638388638720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748419.374622:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388638720:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.374633:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388638080:0@lo:400:kworker.0 00000100:00100000:2.0:1788748419.374642:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388638592:0@lo:400:kworker.0 00000100:00100000:1.0:1788748419.374770:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388639232:12345-0@lo:400:kworker.0 Request processed in 2469us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748419.374777:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:0.0:1788748419.374864:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748419.374869:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748419.374872:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748419.374986:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388639104:0@lo:400:kworker.0 00010000:00080000:2.0:1788748419.375010:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8380e300 x1875638388639232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748419.375020:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388639232:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.375991:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638976 00000100:00100000:3.0:1788748419.376002:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638976 00000100:00100000:3.0:1788748419.376080:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388638848 00000100:00100000:3.0:1788748419.376084:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388638848 00000100:00100000:3.0:1788748419.376120:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748419.376129:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388638976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.376209:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388638976:12345-0@lo:400:kworker.0 Request processed in 82us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748419.376215:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748419.376229:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788748419.376234:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388638848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.376262:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388638848:12345-0@lo:400:kworker.0 Request processed in 27us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748419.376267:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788748419.376353:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388638848:0@lo:400:kworker.0 00000100:00100000:3.0:1788748419.376367:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388638976:0@lo:400:kworker.0 00000100:00080000:0.0:1788748419.376556:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748419.876629:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388639360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748419.876702:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.876772:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388639360 00000100:00100000:2.0:1788748419.876781:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388639360 00000100:00100000:2.0:1788748419.876828:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788748419.876837:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388639360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748419.876876:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748419.876928:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388639360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748419.876936:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788748419.877027:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388639360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748419.878414:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388639488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748419.878470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748419.878600:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388639488 00000100:00100000:2.0:1788748419.878606:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388639488 00000100:00100000:2.0:1788748419.878651:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788748419.878662:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388639488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748419.878697:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748419.878746:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388639488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748419.878753:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788748419.882386:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388639488:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788748420.390390:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748420.918455:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748420.918513:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748420.918514:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630144 00000100:00100000:3.0:1788748420.918536:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630144 00000100:00100000:2.0:1788748420.918555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748420.918579:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630400 00000100:00100000:0.0:1788748420.918584:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630400 00000100:00100000:3.0:1788748420.918597:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 372 00000100:00100000:3.0:1788748420.918611:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368630144:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748420.918636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630272 00000100:00100000:0.0:1788748420.918641:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630272 00000100:00080000:2.0:1788748420.918648:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748420.918653:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748420.918654:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:1.0:1788748420.918668:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368630400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748420.918675:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:0.0:1788748420.918686:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368630272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748420.918805:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368630144:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 197us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748420.918813:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 372 00000100:00100000:1.0:1788748420.918869:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368630400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 204us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748420.921688:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368630272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 2992us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748420.921701:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:1.0:1788748420.921920:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:2.0:1788748420.948516:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748420.948558:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748420.948603:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748420.948751:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630656 00000100:00100000:0.0:1788748420.948761:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630656 00000100:00100000:0.0:1788748420.948828:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630784 00000100:00100000:0.0:1788748420.948831:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630784 00000100:00100000:0.0:1788748420.948854:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:0.0:1788748420.948863:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368630656:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748420.948929:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368630656:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748420.948937:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:0.0:1788748420.948964:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1788748420.948972:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368630784:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748420.948997:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368630784:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748420.949003:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00080000:2.0:1788748420.949056:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748420.949060:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748420.949088:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630528 00000100:00100000:1.0:1788748420.949106:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630528 00000100:00100000:1.0:1788748420.949143:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1788748420.949151:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2409:x1875638368630528:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1788748420.949169:0:8734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e1a17f 00000100:00080000:1.0:1788748420.949178:0:8734:0:(import.c:65:import_set_state_nolock()) ffff8addbf46a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748420.953969:0:8734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788748420.954279:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788748420.954359:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748420.954464:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+2:2409:x1875638368630528:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 5307us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748420.954475:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00010000:00010000:2.0:1788748421.412480:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748421.925098:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388639616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748421.925175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748421.925348:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388639616 00000100:00100000:3.0:1788748421.925357:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388639616 00000100:00100000:3.0:1788748421.925403:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788748421.925412:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388639616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788748421.925445:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788748421.925489:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388639616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748421.925496:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788748421.933204:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388639616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748422.436759:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748423.460504:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748423.973611:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388639744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748423.973685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748423.973840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388639744 00000100:00100000:1.0:1788748423.973848:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388639744 00000100:00100000:1.0:1788748423.973903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788748423.973914:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388639744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748423.973958:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748423.974007:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388639744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748423.974014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788748423.974109:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388639744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748424.487212:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748424.487240:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388639872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748424.487334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748424.487414:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388639872 00000100:00100000:0.0:1788748424.487425:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388639872 00000100:00100000:0.0:1788748424.487486:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788748424.487494:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388639872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788748424.487524:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748424.487569:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388639872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748424.487577:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788748424.487597:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748424.487641:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c2a00 x1875638388639872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748424.487660:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388639872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748424.487900:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388640000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748424.487941:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748424.487975:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640000 00000100:00100000:0.0:1788748424.487979:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640000 00000100:00100000:0.0:1788748424.488006:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788748424.488013:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388640000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748424.488025:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748424.488057:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388640000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748424.488064:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788748424.488094:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788748424.488113:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb3929c00 x1875638388640000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748424.488127:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388640000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748424.513449:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388640384:0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.513520:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748424.513573:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388640896:0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.513602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748424.513640:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388641408:0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.513663:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748424.516007:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640896 00000100:00100000:3.0:1788748424.516023:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640896 00000100:00100000:3.0:1788748424.516096:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641408 00000100:00100000:3.0:1788748424.516100:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641408 00000100:00100000:3.0:1788748424.516197:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788748424.516209:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388640896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748424.516297:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388640896:12345-0@lo:400:kworker.0 Request processed in 91us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748424.516304:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788748424.516340:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788748424.516347:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388641408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748424.516377:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388641408:12345-0@lo:400:kworker.0 Request processed in 31us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748424.516400:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:3.0:1788748424.516430:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788748424.518382:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb392b800 x1875638388640896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748424.518402:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388640896:0@lo:400:kworker.0 00010000:00080000:0.0:1788748424.518423:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc81fb80 x1875638388641408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748424.518434:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc81fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388641408:0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.518463:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788748424.518477:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388640512:0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.518540:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748424.518581:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640512 00000100:00100000:0.0:1788748424.518586:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388641024:0@lo:400:kworker.0 00000100:00100000:3.0:1788748424.518588:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640512 00000100:00100000:0.0:1788748424.518622:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748424.518630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788748424.518639:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388640512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.518671:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640384 00000100:00100000:0.0:1788748424.518678:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640384 00000100:00100000:3.0:1788748424.518701:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388640512:12345-0@lo:400:kworker.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748424.518709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788748424.518806:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388640512:0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.522620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788748424.522650:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388640384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.522757:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388640384:12345-0@lo:400:kworker.0 Request processed in 116us (9237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748424.522765:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788748424.522833:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388640384:0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.522896:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641024 00000100:00100000:0.0:1788748424.522903:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641024 00000100:00080000:3.0:1788748424.522953:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748424.522976:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788748424.522986:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388641024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748424.523039:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388641024:12345-0@lo:400:kworker.0 Request processed in 54us (4415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748424.523046:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788748424.523084:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388641024:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.526826:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388640128:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.526899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.526965:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388640640:0@lo:400:kworker.0 00010000:00010000:1.0:1788748424.527499:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748424.528108:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.528153:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388641152:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.528195:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.528223:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788748424.528229:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388640256:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.528251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.528267:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388640768:0@lo:400:kworker.0 00000100:00100000:1.0:1788748424.528479:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640640 00000100:00100000:1.0:1788748424.528487:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640640 00000100:00100000:1.0:1788748424.528528:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788748424.528536:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388640640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748424.528595:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388640640:12345-0@lo:400:kworker.0 Request processed in 60us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.528602:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788748424.528694:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.528726:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388641280:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.528752:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748424.528792:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388640640:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.528829:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641152 00000100:00100000:2.0:1788748424.528833:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641152 00000100:00100000:2.0:1788748424.528869:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788748424.528876:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388641152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.528912:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388641152:12345-0@lo:400:kworker.0 Request processed in 37us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.528919:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788748424.528956:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640128 00000100:00100000:2.0:1788748424.528960:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640128 00000100:00100000:1.0:1788748424.529094:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640256 00000100:00100000:1.0:1788748424.529099:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640256 00000100:00100000:1.0:1788748424.529138:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388640768 00000100:00100000:1.0:1788748424.529141:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388640768 00000100:00100000:1.0:1788748424.529170:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641280 00000100:00100000:1.0:1788748424.529173:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641280 00000100:00100000:1.0:1788748424.529189:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788748424.529197:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388640256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748424.529231:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388640256:12345-0@lo:400:kworker.0 Request processed in 36us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.529238:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788748424.529250:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788748424.529256:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388640768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.530089:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788748424.530110:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388640128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.530166:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388640128:12345-0@lo:400:kworker.0 Request processed in 64us (3268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.530185:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788748424.530242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788748424.530250:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388641280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748424.537108:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388640768:12345-0@lo:400:kworker.0 Request processed in 7842us (8403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.537125:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788748424.539544:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748424.539553:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748424.539617:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388640256:0@lo:400:kworker.0 00000100:00100000:3.0:1788748424.539633:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388640768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748424.539644:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388640128:0@lo:400:kworker.0 00000100:00100000:3.0:1788748424.539655:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388641152:0@lo:400:kworker.0 00000100:00100000:2.0:1788748424.542135:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388641280:12345-0@lo:400:kworker.0 Request processed in 11876us (13373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748424.542150:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788748424.542409:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388641280:0@lo:400:kworker.0 00000100:00100000:1.0:1788748424.997896:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748424.997919:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388641536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748424.997999:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748424.998083:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641536 00000100:00100000:1.0:1788748424.998092:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641536 00000100:00100000:1.0:1788748424.998142:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788748424.998152:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388641536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748424.998184:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748424.998231:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388641536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748424.998238:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788748424.998291:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388641536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748425.002116:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388641664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748425.002184:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748425.002295:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641664 00000100:00100000:3.0:1788748425.002303:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641664 00000100:00100000:3.0:1788748425.002390:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788748425.002400:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388641664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748425.002421:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748425.002469:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388641664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748425.002483:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788748425.002675:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388641664:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788748425.573050:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748425.573292:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788748425.574084:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788748426.040132:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748426.040427:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748426.040468:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748426.040494:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748426.040517:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748426.040551:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631168 00000100:00100000:2.0:1788748426.040559:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631168 00000100:00100000:2.0:1788748426.040611:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631424 00000100:00100000:2.0:1788748426.040614:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631424 00000100:00100000:2.0:1788748426.040628:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631040 00000100:00100000:2.0:1788748426.040630:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631040 00000100:00100000:2.0:1788748426.040643:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631296 00000100:00100000:2.0:1788748426.040645:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631296 00000100:00100000:2.0:1788748426.040662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 247 00000100:00100000:2.0:1788748426.040671:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368631168:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748426.040751:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368631168:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 81us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748426.040759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 247 00000100:00100000:2.0:1788748426.040777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:2.0:1788748426.040784:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368631424:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748426.040810:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368631424:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748426.040815:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:2.0:1788748426.040826:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 249 00000100:00100000:2.0:1788748426.040831:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368631040:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748426.040854:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368631040:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748426.040860:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 249 00000100:00100000:2.0:1788748426.040870:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:2.0:1788748426.040875:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368631296:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748426.040894:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368631296:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 19us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748426.040899:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00080000:2.0:1788748426.040916:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748426.040931:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748426.045455:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368630912 00000100:00100000:0.0:1788748426.045470:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368630912 00000100:00100000:0.0:1788748426.045544:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 374 00000100:00100000:0.0:1788748426.045555:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368630912:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748426.045641:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368630912:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 88us (5519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748426.045648:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 374 00010000:00010000:1.0:1788748426.597259:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748427.044698:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748427.044729:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388641792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748427.044828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748427.045051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641792 00000100:00100000:0.0:1788748427.045062:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641792 00000100:00100000:0.0:1788748427.045141:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788748427.045154:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388641792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748427.045199:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788748427.045280:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388641792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748427.045288:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788748427.045801:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388641792:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788748427.056940:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:1.0:1788748427.057257:0:8419:0:(genops.c:885:class_export_put()) final put ffff8addbf46e000/53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:2.0:1788748427.057538:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf46e000/53dfbad0-5125-4663-8fa7-3e1aae0338a8 for lustre-OST0000 00000020:00000080:2.0:1788748427.057836:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf46a800 for lustre-OST0000 00010000:00010000:0.0:1788748427.632664:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748428.645014:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748429.093206:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388641920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748429.093281:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748429.093489:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388641920 00000100:00100000:1.0:1788748429.093498:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388641920 00000100:00100000:1.0:1788748429.093551:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788748429.093560:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388641920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748429.093612:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748429.093670:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388641920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748429.093677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788748429.094006:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388641920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748429.606348:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748429.606479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748429.609309:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642048 00000100:00100000:1.0:1788748429.609344:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642048 00000100:00100000:1.0:1788748429.609437:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788748429.609452:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388642048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748429.609502:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748429.609585:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388642304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748429.609604:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388642048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748429.609613:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788748429.609654:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748429.609665:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.609751:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388642816:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.609793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.609817:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388643328:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.609838:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.609874:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788748429.609881:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388642176:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.609922:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.609946:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388642688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.609969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.609986:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388643200:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.610037:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388642432:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610057:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.610071:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388642944:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.610113:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388643456:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610131:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.610143:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788748429.610148:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388642560:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610188:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.610204:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388643072:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610220:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.610232:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388643584:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610246:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748429.610271:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642304 00000100:00100000:3.0:1788748429.610279:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642304 00000100:00100000:3.0:1788748429.610363:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748429.610372:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388642304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748429.610394:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748429.610443:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388642304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610449:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748429.610473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642816 00000100:00100000:3.0:1788748429.610476:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642816 00000100:00100000:3.0:1788748429.610504:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643328 00000100:00100000:3.0:1788748429.610508:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643328 00000100:00100000:3.0:1788748429.610524:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642688 00000100:00100000:3.0:1788748429.610527:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642688 00000100:00100000:3.0:1788748429.610537:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642432 00000100:00100000:3.0:1788748429.610539:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642432 00000100:00100000:3.0:1788748429.610547:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642944 00000100:00100000:3.0:1788748429.610549:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642944 00000100:00100000:3.0:1788748429.610558:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643456 00000100:00100000:3.0:1788748429.610560:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643456 00000100:00100000:3.0:1788748429.610570:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788748429.610576:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388642816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610609:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388642816:12345-0@lo:400:kworker.0 Request processed in 33us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610622:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788748429.610635:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788748429.610640:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388643328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610663:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388643328:12345-0@lo:400:kworker.0 Request processed in 23us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610668:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788748429.610676:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788748429.610681:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388642688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610700:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388642688:12345-0@lo:400:kworker.0 Request processed in 19us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788748429.610712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788748429.610717:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388642432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610748:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388642432:12345-0@lo:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610753:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788748429.610762:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788748429.610767:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388642944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610788:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8412bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388642944:12345-0@lo:400:kworker.0 Request processed in 22us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610793:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788748429.610801:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788748429.610806:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388643456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610825:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388643456:12345-0@lo:400:kworker.0 Request processed in 19us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610836:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788748429.610856:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642176 00000100:00100000:3.0:1788748429.610859:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642176 00000100:00100000:3.0:1788748429.610884:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788748429.610889:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388642176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.610929:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388642176:12345-0@lo:400:kworker.0 Request processed in 40us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.610934:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788748429.610966:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643200 00000100:00100000:3.0:1788748429.610970:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643200 00000100:00100000:3.0:1788748429.610994:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643072 00000100:00100000:3.0:1788748429.610996:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643072 00000100:00100000:3.0:1788748429.611008:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643584 00000100:00100000:3.0:1788748429.611010:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643584 00000100:00100000:3.0:1788748429.611021:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788748429.611028:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388643200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611059:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388643200:12345-0@lo:400:kworker.0 Request processed in 32us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.611066:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788748429.611079:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788748429.611085:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388643072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611109:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388643072:12345-0@lo:400:kworker.0 Request processed in 25us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.611115:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788748429.611124:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788748429.611129:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388643584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611178:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388643584:12345-0@lo:400:kworker.0 Request processed in 48us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.611187:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788748429.611225:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388642560 00000100:00100000:2.0:1788748429.611225:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388643072:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611233:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388642560 00010000:00080000:2.0:1788748429.611254:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c5180 x1875638388643584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748429.611269:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788748429.611276:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388643584:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611286:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388642560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748429.611305:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388642432:0@lo:400:kworker.0 00010000:00080000:2.0:1788748429.611353:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc840bb100 x1875638388642944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748429.611364:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388642944:0@lo:400:kworker.0 00010000:00080000:2.0:1788748429.611378:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbf4c5c00 x1875638388643456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748429.611386:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388643456:0@lo:400:kworker.0 00000100:00100000:2.0:1788748429.611442:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388642560:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611444:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388642560:12345-0@lo:400:kworker.0 Request processed in 159us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748429.611461:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788748429.611496:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748429.611501:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748429.611503:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748429.611505:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788748429.611541:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83ccb480 x1875638388642048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748429.611563:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748429.611692:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388642176:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611704:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388642688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611716:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388643200:0@lo:400:kworker.0 00010000:00080000:3.0:1788748429.611727:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a1500 x1875638388642304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748429.611741:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388642304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748429.611758:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388642816:0@lo:400:kworker.0 00000100:00100000:3.0:1788748429.611781:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388643328:0@lo:400:kworker.0 00010000:00010000:1.0:1788748429.669302:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748430.116794:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748430.116818:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc81ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388643712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748430.116888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748430.118515:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643712 00000100:00100000:0.0:1788748430.118527:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643712 00000100:00100000:3.0:1788748430.118730:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748430.118745:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388643840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748430.118801:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748430.119691:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643840 00000100:00100000:0.0:1788748430.119699:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643840 00000100:00100000:0.0:1788748430.119733:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788748430.119741:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388643712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748430.119772:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748430.119827:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388643712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748430.119833:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788748430.119851:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788748430.119857:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388643840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748430.119866:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748430.119905:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388643840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748430.119910:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788748430.119965:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388643840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748430.120004:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc81ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388643712:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788748430.183562:0:14050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:33:49 (1788748429) 00010000:00010000:0.0:1788748430.693900:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748431.159227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748431.159271:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748431.159301:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748431.159361:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748431.159383:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748431.159724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631808 00000100:00100000:3.0:1788748431.159743:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631808 00000100:00100000:3.0:1788748431.159799:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368632064 00000100:00100000:3.0:1788748431.159802:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368632064 00000100:00100000:3.0:1788748431.159821:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631680 00000100:00100000:3.0:1788748431.159823:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631680 00000100:00100000:3.0:1788748431.159841:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 257 00000100:00100000:3.0:1788748431.159850:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368631808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748431.159933:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368631808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 83us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748431.159940:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 257 00000100:00100000:3.0:1788748431.159958:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 258 00000100:00100000:3.0:1788748431.159965:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368632064:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748431.159989:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368632064:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748431.159996:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 258 00000100:00100000:3.0:1788748431.160007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 259 00000100:00100000:3.0:1788748431.160013:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368631680:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748431.160036:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368631680:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748431.160056:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 259 00000100:00080000:3.0:1788748431.160079:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748431.160083:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788748431.160984:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631936 00000100:00100000:1.0:1788748431.160991:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631936 00000100:00100000:1.0:1788748431.161050:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 260 00000100:00100000:1.0:1788748431.161059:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368631936:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748431.161122:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368631936:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 64us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748431.161143:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 260 00000100:00100000:2.0:1788748431.161615:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368631552 00000100:00100000:2.0:1788748431.161621:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368631552 00000100:00100000:2.0:1788748431.161666:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 376 00000100:00100000:2.0:1788748431.161674:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368631552:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748431.161722:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368631552:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 49us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748431.161729:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 376 00000100:00080000:0.0:1788748431.162029:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788748431.716492:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748432.059043:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748432.059120:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368632192 00000100:00100000:3.0:1788748432.059129:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368632192 00000100:00100000:3.0:1788748432.059188:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1788748432.059200:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:11084:x1875638368632192:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748432.059221:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748432.059245:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1a25f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b98 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.059309:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1a266 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.059357:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1a266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.059372:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1a266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748432.059417:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788748432.059421:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748432.059460:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1a266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.059483:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1a25f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b98 expref: 7 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.059502:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1a266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b98 expref: 6 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.059525:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113500) 00010000:00010000:3.0:1788748432.059528:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748432.059532:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77800, rc 0) 00000100:00100000:3.0:1788748432.059607:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:11084:x1875638368632192:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 409us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748432.059614:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1788748432.067664:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748432.067761:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368632320 00000100:00100000:1.0:1788748432.067771:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368632320 00000100:00100000:1.0:1788748432.067826:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:1.0:1788748432.067836:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:11085:x1875638368632320:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748432.067857:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748432.067876:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a26d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3b9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.067948:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.067963:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.067975:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.067990:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.067997:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068004:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068067:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a282 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068096:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068104:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748432.068144:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788748432.068148:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748432.068168:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a282 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068178:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068185:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068192:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068199:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748432.068203:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068211:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068221:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113500) 00010000:00010000:1.0:1788748432.068224:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748432.068230:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068245:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068258:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068264:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068270:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068274:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748432.068277:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068283:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068290:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8addba6a9100) 00010000:00010000:1.0:1788748432.068293:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748432.068295:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068300:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1a27b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068387:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a26d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b9f expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068401:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a282 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b9f expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748432.068414:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8addba6a9900) 00010000:00010000:1.0:1788748432.068417:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748432.068419:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69600, rc 0) 00000100:00100000:1.0:1788748432.068485:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:11085:x1875638368632320:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 649us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748432.068492:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:1.0:1788748432.073209:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748432.073296:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368632448 00000100:00100000:0.0:1788748432.073307:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368632448 00000100:00100000:0.0:1788748432.073389:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788748432.073400:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:11085:x1875638368632448:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788748432.073486:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:11085:x1875638368632448:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748432.073494:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788748432.075050:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748432.075129:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368632704 00000100:00100000:3.0:1788748432.075138:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368632704 00000100:00100000:3.0:1788748432.075193:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1788748432.075202:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:11085:x1875638368632704:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748432.075219:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748432.075240:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1a289 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ba6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075313:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075369:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075381:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075433:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075441:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075461:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075568:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77a00/0x9ba0f20a02e1a29e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075588:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77a00/0x9ba0f20a02e1a29e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075596:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77a00/0x9ba0f20a02e1a29e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748432.075605:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788748432.075691:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075698:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075704:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075710:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748432.075713:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075721:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075732:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8addba6a9900) 00010000:00010000:3.0:1788748432.075735:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748432.075746:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075752:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1a290 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075766:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075772:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075777:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075782:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748432.075785:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075790:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075798:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8addb5113600) 00010000:00010000:3.0:1788748432.075800:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748432.075803:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.075807:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1a297 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.076641:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1a289 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ba6 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.076675:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77a00/0x9ba0f20a02e1a29e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ba6 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748432.076682:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:3.0:1788748432.076684:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748432.076686:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77a00, rc 0) 00000100:00100000:3.0:1788748432.076754:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:11085:x1875638368632704:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1553us (1712us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788748432.076764:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1788748432.081243:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748432.083014:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368632832 00000100:00100000:0.0:1788748432.083027:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368632832 00000100:00100000:0.0:1788748432.083098:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788748432.083108:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:11085:x1875638368632832:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788748432.083225:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:11085:x1875638368632832:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 119us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748432.083233:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1788748432.085803:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748432.087047:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368632960 00000100:00100000:0.0:1788748432.087065:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368632960 00000100:00100000:0.0:1788748432.088276:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1788748432.088297:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:11085:x1875638368632960:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788748432.094648:0:8447:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6256us 00000100:00100000:0.0:1788748432.120178:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:11085:x1875638368632960:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 31875us (34375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748432.120194:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:2.0:1788748432.165247:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388643968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748432.165381:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748432.166980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388643968 00000100:00100000:0.0:1788748432.167002:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388643968 00000100:00100000:0.0:1788748432.167086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788748432.167109:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388643968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748432.167159:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788748432.167273:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388643968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748432.167279:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788748432.169061:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388643968:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788748432.741307:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788748432.743043:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748432.743108:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748433.764672:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748434.219798:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388644096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748434.219878:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748434.224771:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644096 00000100:00100000:1.0:1788748434.225441:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644096 00000100:00100000:1.0:1788748434.225648:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788748434.225659:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388644096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748434.225696:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748434.225778:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388644096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (5900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748434.225784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788748434.232414:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388644096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748434.567267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748434.567378:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368633088 00000100:00100000:3.0:1788748434.567389:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368633088 00000100:00080000:0.0:1788748434.567442:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748434.567458:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1788748434.567469:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:11127:x1875638368633088:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748434.567488:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748434.567509:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a2ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bad expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567654:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567669:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567690:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567706:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567712:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567719:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567760:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567767:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567774:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567780:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748434.567785:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567792:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567803:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113500) 00010000:00010000:3.0:1788748434.567806:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748434.567812:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567825:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a2b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567839:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567845:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567852:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567857:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbbe00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748434.567860:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567877:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567887:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8add864c2a00) 00010000:00010000:3.0:1788748434.567890:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748434.567893:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567899:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a2ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567931:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a2ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bad expref: 10 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567954:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113500) 00010000:00010000:3.0:1788748434.567956:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748434.567960:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a2ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bad expref: 10 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.567970:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb000, rc 0) 00000100:00100000:3.0:1788748434.570205:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:11127:x1875638368633088:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2727us (2937us total) trans 0 rc 301/301 00000100:00100000:3.0:1788748434.570216:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1788748434.581554:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748434.587133:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368633344 00000100:00100000:1.0:1788748434.587147:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368633344 00000100:00100000:1.0:1788748434.587210:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1788748434.587221:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:11127:x1875638368633344:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:1.0:1788748434.587274:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748434.587299:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1a266 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b98 expref: 9 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587356:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addb5113500) 00010000:00010000:1.0:1788748434.587368:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748434.587434:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587446:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587456:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587469:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587476:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587483:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587982:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587992:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.587999:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748434.588015:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004f2b005e reply state 00000000321b7b4a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588041:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588048:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748434.588052:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748434.588055:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788748434.588060:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788748434.588068:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588075:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588083:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588089:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748434.588093:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588100:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588108:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8addba6a8c00) 00010000:00010000:1.0:1788748434.588110:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748434.588114:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588120:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a2c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748434.588144:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004f2b005e reply state 00000000321b7b4a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588153:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748434.588158:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8addba6a8700) 00010000:00010000:1.0:1788748434.588161:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748434.588163:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788748434.588271:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:11127:x1875638368633344:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 1050us (6726us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788748434.588279:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788748434.724774:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388644480:0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.724839:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748434.724902:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388644992:0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.724922:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748434.724942:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388645504:0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.724983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748434.725014:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788748434.725020:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388644608:0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.725041:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748434.725053:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388645120:0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.725068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748434.725091:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388645632:0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.725107:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748434.725134:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644480 00000100:00100000:3.0:1788748434.725140:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644480 00000100:00100000:0.0:1788748434.725343:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388644224:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748434.725402:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388644736:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748434.725438:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388645248:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725456:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748434.725472:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788748434.725486:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388644352:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748434.725526:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388644864:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725547:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748434.725572:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388645376:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725591:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748434.725613:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644608 00000100:00100000:0.0:1788748434.725616:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644608 00000100:00100000:0.0:1788748434.725639:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644736 00000100:00100000:0.0:1788748434.725641:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644736 00000100:00100000:0.0:1788748434.725661:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388645248 00000100:00100000:0.0:1788748434.725663:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388645248 00000100:00100000:0.0:1788748434.725672:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644352 00000100:00100000:0.0:1788748434.725674:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644352 00000100:00100000:0.0:1788748434.725682:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644864 00000100:00100000:0.0:1788748434.725684:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644864 00000100:00100000:0.0:1788748434.725694:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388645376 00000100:00100000:0.0:1788748434.725695:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388645376 00000100:00100000:0.0:1788748434.725708:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788748434.725715:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388644608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725761:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388644608:12345-0@lo:400:kworker.0 Request processed in 47us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.725768:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788748434.725781:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788748434.725786:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388644736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725809:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388644736:12345-0@lo:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.725814:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788748434.725830:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788748434.725835:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388645248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725857:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388645248:12345-0@lo:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.725873:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788748434.725883:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788748434.725888:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388644352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725914:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388644352:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.725919:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788748434.725928:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788748434.725934:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388644864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.725958:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388644864:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.725963:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788748434.725973:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788748434.725978:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388645376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726002:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388645376:12345-0@lo:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.726007:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788748434.726024:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644224 00000100:00100000:0.0:1788748434.726028:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644224 00000100:00100000:0.0:1788748434.726053:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788748434.726059:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388644224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726101:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388644224:12345-0@lo:400:kworker.0 Request processed in 42us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.726113:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:0.0:1788748434.726145:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748434.726149:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748434.726450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388644352:0@lo:400:kworker.0 00010000:00080000:0.0:1788748434.726469:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83f81f80 x1875638388644864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748434.726479:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388644864:0@lo:400:kworker.0 00010000:00080000:0.0:1788748434.726490:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f160000 x1875638388645376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748434.726497:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388645376:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726504:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388644224:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726513:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388644736:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726521:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388645248:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726586:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388644608:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726633:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388644992 00000100:00100000:0.0:1788748434.726637:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388644992 00000100:00100000:0.0:1788748434.726664:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388645504 00000100:00100000:0.0:1788748434.726667:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388645504 00000100:00100000:0.0:1788748434.726685:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388645120 00000100:00100000:0.0:1788748434.726688:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388645120 00000100:00100000:0.0:1788748434.726697:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388645632 00000100:00100000:0.0:1788748434.726699:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388645632 00000100:00100000:0.0:1788748434.726711:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788748434.726716:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388644992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726771:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388644992:12345-0@lo:400:kworker.0 Request processed in 54us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.726777:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788748434.726790:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748434.726796:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388645504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726824:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388645504:12345-0@lo:400:kworker.0 Request processed in 28us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.726829:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788748434.726840:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748434.726845:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388645120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726898:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388645120:12345-0@lo:400:kworker.0 Request processed in 53us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.726903:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788748434.726915:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788748434.726920:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388645632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.726946:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388645632:12345-0@lo:400:kworker.0 Request processed in 27us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.726952:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1788748434.726972:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748434.726974:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748434.726990:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388645120:0@lo:400:kworker.0 00010000:00080000:0.0:1788748434.727002:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addbc83a300 x1875638388645632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748434.727010:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388645632:0@lo:400:kworker.0 00000100:00100000:0.0:1788748434.727020:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388644992:0@lo:400:kworker.0 00010000:00080000:0.0:1788748434.727038:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f161180 x1875638388645504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748434.727048:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388645504:0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.727239:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788748434.727248:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388644480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748434.727292:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388644480:12345-0@lo:400:kworker.0 Request processed in 47us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748434.727298:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788748434.727355:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388644480:0@lo:400:kworker.0 00000100:00100000:2.0:1788748434.727839:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748434.727851:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388645760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748434.727903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748434.729959:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388645760 00000100:00100000:0.0:1788748434.729972:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388645760 00000100:00100000:0.0:1788748434.730424:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788748434.730435:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388645760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788748434.730466:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748434.730543:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388645760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.730549:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788748434.732029:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748434.732052:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388645888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748434.732109:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788748434.732250:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc83ccbb80 x1875638388645760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748434.732272:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388645760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748434.732344:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388645888 00000100:00100000:1.0:1788748434.732351:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388645888 00000100:00100000:1.0:1788748434.732392:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788748434.732399:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388645888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748434.732430:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748434.732471:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388645888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748434.732478:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788748434.732507:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a2d80 x1875638388645888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748434.732520:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388645888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748434.735818:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748434.735895:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368633472 00000100:00100000:2.0:1788748434.735904:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368633472 00000100:00100000:2.0:1788748434.735956:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1788748434.735964:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:11135:x1875638368633472:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:2.0:1788748434.735985:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748434.736005:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a2d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bb4 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.736065:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fb200/0x9ba0f20a02e1a2dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.736094:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fb200/0x9ba0f20a02e1a2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.736107:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fb200/0x9ba0f20a02e1a2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748434.736150:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788748434.736153:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748434.736187:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fb200/0x9ba0f20a02e1a2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.736210:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a2d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bb4 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.736228:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fb200/0x9ba0f20a02e1a2dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bb4 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.736237:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:2.0:1788748434.736240:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748434.736243:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813fb200, rc 0) 00000100:00100000:2.0:1788748434.736303:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:11135:x1875638368633472:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 340us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748434.736310:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00010000:00010000:2.0:1788748434.788803:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748434.807983:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748434.809993:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368633600 00000100:00100000:0.0:1788748434.810008:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368633600 00000100:00100000:0.0:1788748434.810095:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1788748434.810106:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:11141:x1875638368633600:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748434.810126:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748434.810145:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a2e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810209:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810222:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810235:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810262:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810270:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810277:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810379:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a2f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810388:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810394:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748434.810430:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788748434.810434:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748434.810469:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810482:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810488:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810495:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810510:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748434.810515:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810522:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810536:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:0.0:1788748434.810539:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748434.810544:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810550:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a2eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810562:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810568:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810574:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810579:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748434.810582:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810588:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810606:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8addba6a8700) 00010000:00010000:0.0:1788748434.810609:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748434.810612:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810618:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a2f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810645:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a2e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bbb expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810658:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bbb expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.810665:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748434.810667:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788748434.810670:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941800, rc 0) 00000100:00100000:0.0:1788748434.810738:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:11141:x1875638368633600:12345-192.168.203.22@tcp:101:bash.0 Request processed in 633us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.810746:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:3.0:1788748434.815212:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748434.815415:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368633856 00000100:00100000:0.0:1788748434.815425:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368633856 00000100:00100000:0.0:1788748434.815481:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:0.0:1788748434.815491:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:11141:x1875638368633856:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748434.815512:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748434.815533:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a300 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bc2 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.815681:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.815707:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.815720:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.815764:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.815772:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.815779:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748434.816114:0:10244:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788748434.816247:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816257:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816266:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816299:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816342:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816351:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816357:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748434.816367:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816376:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816390:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748434.816393:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748434.816399:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816406:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a307 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748434.816420:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a0792588 reply state 000000008f3a1bb3 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816432:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816439:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:0.0:1788748434.816441:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788748434.816444:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788748434.816475:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a300 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 15 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816498:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 14 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.816505:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748434.816508:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748434.816510:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941600, rc 0) 00000100:00100000:0.0:1788748434.816574:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11141:x1875638368633856:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1084us (1372us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788748434.816581:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1788748434.821804:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748434.822777:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368633984 00000100:00100000:0.0:1788748434.822794:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368633984 00000100:00100000:0.0:1788748434.822854:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:0.0:1788748434.822871:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875638368633984:12345-192.168.203.22@tcp:8:bash.0 00010000:00080000:0.0:1788748434.822910:0:8425:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1788748434.822948:0:8425:0:(genops.c:1384:class_connect()) connect: client 53dfbad0-5125-4663-8fa7-3e1aae0338a8, cookie 0x9ba0f20a02e1a323 00002000:00100000:0.0:1788748434.822962:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 53dfbad0-5125-4663-8fa7-3e1aae0338a8/ffff8adc838ba800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788748434.822974:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788748434.823057:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788748434.823094:0:8425:0:(import.c:65:import_set_state_nolock()) ffff8adc838b9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748434.823231:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2409:x1875638368633984:12345-192.168.203.22@tcp:8:bash.0 Request processed in 367us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.823239:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:3.0:1788748434.833272:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748434.833995:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368634112 00000100:00100000:0.0:1788748434.834006:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368634112 00000100:00100000:0.0:1788748434.834096:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1788748434.834105:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:0:x1875638368634112:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748434.834124:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748434.834146:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bc9 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748434.834172:0:8424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748434.834190:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1788748434.834196:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748434.834205:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.834237:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 7 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748434.834251:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748434.834342:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:0:x1875638368634112:12345-192.168.203.22@tcp:101:bash.0 Request processed in 211us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748434.834350:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00080000:2.0:1788748434.835454:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748434.855456:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748434.855925:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368634240 00000100:00100000:3.0:1788748434.855935:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368634240 00000100:00100000:3.0:1788748434.855993:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1788748434.856003:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:11141:x1875638368634240:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788748434.856021:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748434.856043:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bd0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.856072:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.856082:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748434.856086:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748434.856091:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.856137:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 8 pid: 8424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.856153:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 8 pid: 8424 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748434.856168:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875638388646016:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748434.856278:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda7301cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748434.858348:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875638388646016:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748434.858381:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748434.858402:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb000, rc 0) 00000100:00100000:3.0:1788748434.858458:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:11141:x1875638368634240:12345-192.168.203.22@tcp:101:bash.0 Request processed in 2455us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748434.858466:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:1.0:1788748434.859278:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748434.859596:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368634368 00000100:00100000:2.0:1788748434.859604:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368634368 00010000:00010000:2.0:1788748434.859647:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 8 pid: 8424 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748434.859702:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1788748434.859711:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368634368:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748434.859724:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748434.859751:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 8 pid: 8424 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.859764:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 8 pid: 8424 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.859788:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1a32a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc9 expref: 8 pid: 8424 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.859808:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748434.859812:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748434.859820:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.859830:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748434.859874:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748434.859887:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83ccbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6495:1875638388646144:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788748434.859973:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748434.872349:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83ccbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6495:1875638388646144:192.168.203.22@tcp:105: 00010000:00010000:2.0:1788748434.872378:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748434.872439:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368634368:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 12728us (13164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748434.872450:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1788748434.884138:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748434.884251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368634624 00000100:00100000:2.0:1788748434.884260:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368634624 00000100:00100000:2.0:1788748434.884358:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1788748434.884369:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11141:x1875638368634624:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1788748434.885177:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11141:x1875638368634624:12345-192.168.203.22@tcp:35:bash.0 Request processed in 806us (1046us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788748434.885188:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1788748435.022964:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.024389:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368634880 00000100:00100000:0.0:1788748435.024405:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368634880 00000100:00100000:0.0:1788748435.024480:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1788748435.024491:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11151:x1875638368634880:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748435.024518:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.024541:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bd7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748435.024843:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788748435.024965:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a338 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.024981:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:0.0:1788748435.024984:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748435.024990:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.025004:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940200, rc 0) 00000100:00100000:0.0:1788748435.025740:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:11151:x1875638368634880:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1247us (2783us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788748435.025749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:1.0:1788748435.034873:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748435.034968:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368635136 00000100:00100000:3.0:1788748435.034979:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368635136 00000100:00100000:3.0:1788748435.035046:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1788748435.035057:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:11151:x1875638368635136:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788748435.035306:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:11151:x1875638368635136:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 250us (454us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788748435.035360:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1788748435.128504:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.128758:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368635264 00000100:00100000:0.0:1788748435.128770:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368635264 00000100:00100000:0.0:1788748435.128833:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1788748435.128843:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:11157:x1875638368635264:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748435.128885:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.128905:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bde expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.128981:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a34d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.128996:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.129031:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748435.129076:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788748435.129079:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748435.129108:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.129135:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bde expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.129153:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a34d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bde expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.129161:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748435.129164:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748435.129168:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941a00, rc 0) 00000100:00100000:0.0:1788748435.129240:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11157:x1875638368635264:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 397us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748435.129246:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:1.0:1788748435.136101:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.136245:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368635520 00000100:00100000:0.0:1788748435.136256:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368635520 00000100:00100000:0.0:1788748435.136348:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1788748435.136358:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11157:x1875638368635520:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748435.136380:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.136402:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a354 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3be5 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.136529:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a35b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.136542:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a35b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.136566:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a35b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748435.136578:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788748435.136874:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1a354 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3be5 expref: 22 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.136894:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a35b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3be5 expref: 21 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.136902:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748435.136905:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748435.136909:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941200, rc 0) 00000100:00100000:0.0:1788748435.136968:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:11157:x1875638368635520:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 611us (885us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788748435.136975:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1788748435.140064:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.140137:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368635776 00000100:00100000:0.0:1788748435.140149:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368635776 00000100:00100000:0.0:1788748435.140272:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788748435.140283:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:11157:x1875638368635776:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748435.140313:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.140377:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a369 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bec expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.140494:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a370 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.140517:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a370 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.140530:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a370 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748435.140544:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788748435.140662:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1a369 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bec expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.140680:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a370 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bec expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.140688:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748435.140691:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788748435.140695:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748435.140747:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:11157:x1875638368635776:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 466us (693us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788748435.140754:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:1.0:1788748435.147990:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748435.148032:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748435.148209:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368636032 00000100:00100000:2.0:1788748435.148220:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368636032 00000100:00100000:2.0:1788748435.148285:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1788748435.148295:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:2411:x1875638368636032:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748435.148310:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748435.148380:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1a35b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3be5 expref: 23 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.148400:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:2.0:1788748435.148405:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748435.148457:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:2411:x1875638368636032:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 163us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748435.148475:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1788748435.148746:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368635904 00000100:00100000:0.0:1788748435.148751:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368635904 00000100:00100000:0.0:1788748435.148801:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788748435.148810:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2413:x1875638368635904:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:0.0:1788748435.148883:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.148905:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.148914:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788748435.148927:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748435.148931:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.148964:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.148979:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 7 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748435.148993:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8424:1875638388646272:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748435.149091:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a53900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748435.154648:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8424:1875638388646272:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748435.154682:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748435.154938:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.155077:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368636160 00000100:00100000:0.0:1788748435.155084:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368636160 00002000:00100000:0.0:1788748435.155127:0:8430:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8adc8407d880 x1875638368636160/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:181/0 lens 504/0 e 0 to 0 dl 1788748446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748435.155151:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc8407d880 with x1875638368636160 ext(0->12) 00010000:00010000:0.0:1788748435.155160:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 8 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.155176:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 8 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748435.155184:0:8430:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc8407d880 00000100:00100000:0.0:1788748435.155217:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1788748435.155226:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368636160:12345-192.168.203.22@tcp:4:lfs.0 00000001:00100000:0.0:1788748435.162050:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000100:00100000:1.0:1788748435.165195:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2410:x1875638368636160:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 9959us (10248us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788748435.165215:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:1.0:1788748435.165229:0:8430:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8adc8407d880 x1875638368636160/t4294967300(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:181/0 lens 504/448 e 0 to 0 dl 1788748446 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748435.165239:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc8407d880 with x1875638368636160 ext(0->12) 00010000:00010000:1.0:1788748435.165249:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 9 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748435.165271:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 9 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748435.165279:0:8430:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc8407d880 00000100:00100000:1.0:1788748435.170722:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748435.174646:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368636288 00000100:00100000:3.0:1788748435.174661:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368636288 00010000:00010000:3.0:1788748435.174716:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 9 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748435.174767:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1788748435.174777:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2412:x1875638368636288:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748435.174791:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788748435.174809:0:9515:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788748435.174811:0:9515:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788748435 00002000:00010000:3.0:1788748435.174813:0:9515:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788748435 00002000:00010000:3.0:1788748435.174815:0:9515:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788748435 00002000:00010000:3.0:1788748435.174817:0:9515:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788748435.174824:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 9 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748435.174839:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 9 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748435.175396:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a331 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bd0 expref: 9 pid: 8427 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748435.175414:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748435.175418:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748435.175424:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748435.175449:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748435.175496:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748435.175730:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175741:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175765:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175774:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175782:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175797:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748435.175805:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175815:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175826:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.175833:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086934e6f/0x9ba0f20a02e1a37e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748435.175935:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2412:x1875638368636288:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1156us (5385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748435.175944:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788748435.177079:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2413:x1875638368635904:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 28261us (29089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748435.177091:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:3.0:1788748435.183286:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.183427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368636544 00000100:00100000:0.0:1788748435.183436:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368636544 00000100:00100000:0.0:1788748435.183499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1788748435.183509:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:11157:x1875638368636544:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:0.0:1788748435.183591:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a370 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bec expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748435.183824:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788748435.183893:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788748435.184217:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788748435.184261:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.184276:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 26 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.184284:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.184350:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 26 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.184365:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 26 pid: 10244 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748435.184379:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388646400:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748435.184457:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a53cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748435.190445:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748435.190724:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368636672 00000100:00100000:2.0:1788748435.190734:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368636672 00010000:00010000:2.0:1788748435.190779:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 27 pid: 10244 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748435.190822:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788748435.190832:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:2410:x1875638368636672:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748435.190865:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748435.190872:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 27 pid: 10244 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.190887:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 27 pid: 10244 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.190911:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:2.0:1788748435.190917:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.190928:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.190937:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.190956:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748435.191020:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:2410:x1875638368636672:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 189us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748435.191027:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00010000:00010000:0.0:1788748435.191512:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1a315 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bc2 expref: 26 pid: 10244 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748435.191529:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388646400:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748435.191567:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.191576:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.191581:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748435.191709:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788748435.191824:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788748435.192180:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388646528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748435.192237:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748435.192278:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a53480 going to sleep for 11 seconds 00000100:00100000:2.0:1788748435.193850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388646528 00000100:00100000:2.0:1788748435.193887:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388646528 00000100:00100000:2.0:1788748435.193945:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788748435.193954:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388646528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788748435.194091:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388646528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748435.194105:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788748435.194406:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388646528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748435.194810:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788748435.194890:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388646656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748435.194937:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748435.194972:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add96e6eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748435.195342:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388646656 00000100:00100000:3.0:1788748435.195350:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388646656 00000100:00100000:3.0:1788748435.195386:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788748435.195394:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388646656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788748435.195528:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1875638388646656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (590us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788748435.195536:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788748435.195888:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388646656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748435.195937:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788748435.195972:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.195982:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.195990:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.195996:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748435.196001:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.196008:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.196037:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748435.196040:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788748435.196045:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.196050:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a385 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748435.196166:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788748435.196226:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788748435.196236:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352182919269ns, next at 353182917531ns, rc = 0 00000001:00080000:0.0:1788748435.196242:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788748435.196264:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748435.196267:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788748435.196274:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1a370 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bec expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748435.196384:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:11157:x1875638368636544:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 12876us (13107us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788748435.196404:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000020:00080000:0.0:1788748435.196408:0:6514:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788748435.199052:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.199303:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368636800 00000100:00100000:0.0:1788748435.199313:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368636800 00000100:00100000:0.0:1788748435.199385:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:0.0:1788748435.199395:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:11157:x1875638368636800:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748435.199418:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.199439:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a38c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bf3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.199783:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a38c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bf3 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.199800:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a38c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bf3 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.199818:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748435.199822:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748435.199825:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a400, rc 0) 00000100:00100000:0.0:1788748435.199947:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:11157:x1875638368636800:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 553us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748435.199955:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:1.0:1788748435.208388:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748435.208518:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368637056 00000100:00100000:2.0:1788748435.208529:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368637056 00000100:00100000:2.0:1788748435.208599:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788748435.208610:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7039850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:11157:x1875638368637056:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748435.208832:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7039850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+31:11157:x1875638368637056:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 224us (455us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788748435.208840:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:0.0:1788748435.236499:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748435.236522:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb392aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388646784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748435.236605:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748435.236832:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388646784 00000100:00100000:1.0:1788748435.236840:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388646784 00000100:00100000:1.0:1788748435.236913:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788748435.236922:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388646784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748435.236951:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748435.236998:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388646784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748435.237005:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788748435.237048:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb392aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388646784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748435.237398:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388646912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748435.237429:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748435.237511:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388646912 00000100:00100000:0.0:1788748435.237516:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388646912 00000100:00100000:0.0:1788748435.237561:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788748435.237569:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388646912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748435.237580:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788748435.237623:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388646912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748435.237630:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788748435.237832:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388646912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748435.323422:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748435.323729:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368637312 00000100:00100000:3.0:1788748435.323739:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368637312 00000100:00100000:2.0:1788748435.323897:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1788748435.323911:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+31:11167:x1875638368637312:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748435.323940:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748435.323962:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fac00/0x9ba0f20a02e1a393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3bfa expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748435.324083:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788748435.324182:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fac00/0x9ba0f20a02e1a393 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bfa expref: 33 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.324198:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:2.0:1788748435.324201:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748435.324218:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fac00/0x9ba0f20a02e1a393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bfa expref: 33 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.324236:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813fac00, rc 0) 00000100:00100000:2.0:1788748435.324311:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11167:x1875638368637312:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 404us (899us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788748435.325190:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1788748435.327986:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748435.328213:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368637440 00000100:00100000:2.0:1788748435.328226:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368637440 00000100:00100000:2.0:1788748435.328340:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788748435.328351:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11167:x1875638368637440:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:2.0:1788748435.328423:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328440:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328452:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328494:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328503:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328509:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328646:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328665:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328673:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748435.328718:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328731:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328736:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328742:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328748:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813faa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748435.328753:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328760:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328770:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748435.328773:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748435.328778:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.328784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1a3a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329192:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329199:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329206:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329211:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748435.329214:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329220:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329228:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:2.0:1788748435.329230:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748435.329234:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329240:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a3a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329249:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329254:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329260:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329272:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bda00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748435.329275:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329281:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329290:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748435.329292:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748435.329295:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.329301:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748435.329742:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11167:x1875638368637440:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1388us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748435.329751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:1.0:1788748435.332083:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748435.332214:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368637696 00000100:00100000:3.0:1788748435.332224:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368637696 00000100:00100000:3.0:1788748435.332284:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788748435.332294:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11167:x1875638368637696:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788748435.332639:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:11167:x1875638368637696:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 346us (573us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788748435.332648:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788748435.362757:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.363731:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368637952 00000100:00100000:0.0:1788748435.363747:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368637952 00000100:00100000:0.0:1788748435.363838:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1788748435.363874:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:11170:x1875638368637952:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748435.363900:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.363921:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a3b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.363998:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364013:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364024:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364035:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364042:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364049:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364159:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364168:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364176:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748435.364198:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788748435.364272:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364280:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364287:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364294:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748435.364298:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364305:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364360:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748435.364364:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748435.364369:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364376:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364389:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364395:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364411:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364416:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748435.364419:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364425:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364433:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:0.0:1788748435.364436:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748435.364439:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364445:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364485:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a3b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364498:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.364520:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748435.364522:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748435.364524:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a600, rc 0) 00000100:00100000:0.0:1788748435.365046:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:11170:x1875638368637952:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1168us (2297us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788748435.365064:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:1.0:1788748435.369384:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748435.369477:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368638080 00000100:00100000:2.0:1788748435.369486:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368638080 00000100:00100000:2.0:1788748435.369538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:2.0:1788748435.369557:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:11170:x1875638368638080:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1788748435.369627:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369645:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369657:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369701:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369708:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369715:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369721:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bda00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748435.369724:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369731:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369742:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748435.369745:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748435.369749:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.369754:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a3d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748435.369833:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:11170:x1875638368638080:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 285us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748435.369841:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:3.0:1788748435.378022:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748435.378130:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368638336 00000100:00100000:2.0:1788748435.378143:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368638336 00000100:00100000:2.0:1788748435.378196:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788748435.378222:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:11170:x1875638368638336:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748435.378521:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:11170:x1875638368638336:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 299us (508us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788748435.378529:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000040:00080000:0.0:1788748435.813433:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748435.814119:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748435.841521:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.841797:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368638592 00000100:00100000:0.0:1788748435.841808:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368638592 00000100:00100000:0.0:1788748435.841870:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1788748435.841881:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:11202:x1875638368638592:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1788748435.841905:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.841925:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a3e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c08 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.842040:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.842054:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.842066:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748435.842078:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788748435.842189:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a3e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c08 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.842207:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c08 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.842227:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748435.842230:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748435.842244:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748435.844914:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:11202:x1875638368638592:12345-192.168.203.22@tcp:101:cat.0 Request processed in 3021us (3389us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788748435.844927:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1788748435.859480:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748435.859523:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368638720 00000100:00100000:3.0:1788748435.859533:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368638720 00000100:00100000:3.0:1788748435.859603:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1788748435.859614:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:2411:x1875638368638720:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748435.859645:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748435.859672:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a3e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c08 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748435.859692:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748435.859698:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748435.859750:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:2411:x1875638368638720:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748435.859757:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1788748435.863041:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748435.863178:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368638976 00000100:00100000:1.0:1788748435.863188:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368638976 00000100:00100000:1.0:1788748435.863250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:1.0:1788748435.863259:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:11202:x1875638368638976:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:1.0:1788748435.863987:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:11202:x1875638368638976:12345-192.168.203.22@tcp:35:cat.0 Request processed in 725us (962us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788748435.863996:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000040:00080000:3.0:1788748435.881052:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788748435.944720:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.944832:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368639232 00000100:00100000:0.0:1788748435.944842:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368639232 00000100:00100000:0.0:1788748435.944965:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1788748435.944977:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:11208:x1875638368639232:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1788748435.945006:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.945009:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788748435.945046:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1a34d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bde expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.945066:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748435.945071:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748435.945084:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a3f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c0f expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.945189:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.945203:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.945224:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.945255:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.945507:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 38 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748435.945522:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388647040:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748435.945795:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add96e6e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748435.959777:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.959986:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388647040:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748435.960015:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748435.960233:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368639360 00000100:00100000:1.0:1788748435.960241:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368639360 00010000:00010000:1.0:1788748435.960279:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 39 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748435.960347:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1788748435.960369:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:2411:x1875638368639360:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748435.960384:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748435.960395:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 39 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748435.960408:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 39 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748435.960429:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a3cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c01 expref: 39 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748435.960450:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748435.960455:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748435.960464:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748435.960472:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748435.960492:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748435.960565:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:2411:x1875638368639360:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 198us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748435.960572:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00010000:00010000:2.0:1788748435.961217:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.961229:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748435.961250:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788748435.961437:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a3f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 39 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.961456:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 38 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748435.961464:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748435.961467:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748435.961470:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:2.0:1788748435.961594:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:11208:x1875638368639232:12345-192.168.203.22@tcp:101:dd.0 Request processed in 16618us (16882us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788748435.961601:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1788748435.969904:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.970061:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368639488 00000100:00100000:0.0:1788748435.970072:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368639488 00000100:00100000:0.0:1788748435.970134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788748435.970145:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:11208:x1875638368639488:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1788748435.970174:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748435.970197:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a40a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c16 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.970246:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.970260:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.970272:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.970427:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a40a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.970455:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.970464:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748435.970467:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748435.970470:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a600, rc 0) 00000100:00100000:0.0:1788748435.970527:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:11208:x1875638368639488:12345-192.168.203.22@tcp:101:dd.0 Request processed in 383us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748435.970534:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:2.0:1788748435.980971:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748435.983596:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368639744 00000100:00100000:0.0:1788748435.983611:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368639744 00000100:00100000:0.0:1788748435.983694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1788748435.983708:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:11208:x1875638368639744:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:0.0:1788748435.983972:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.983990:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.984002:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748435.984059:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788748435.984083:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005a7b89b3 reply state 00000000c04af684 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.984096:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748435.984118:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748435.984121:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788748435.984125:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748435.984223:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:11208:x1875638368639744:12345-192.168.203.22@tcp:36:dd.0 Request processed in 518us (3264us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788748435.984231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000020:00080000:0.0:1788748435.984236:0:6512:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788748436.279993:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.280082:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.280114:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.280148:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.280178:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.280233:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368640384 00000100:00100000:2.0:1788748436.280245:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368640384 00000100:00100000:2.0:1788748436.280359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368640000 00000100:00100000:2.0:1788748436.280363:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368640000 00000100:00100000:2.0:1788748436.280384:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368640256 00000100:00100000:2.0:1788748436.280387:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368640256 00000100:00100000:2.0:1788748436.280409:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 267 00000100:00100000:2.0:1788748436.280420:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368640384:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748436.280524:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368640384:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 106us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748436.280533:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 267 00000100:00100000:0.0:1788748436.280775:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 268 00000100:00100000:0.0:1788748436.280786:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368640000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748436.280818:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368640000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748436.280824:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 268 00000100:00100000:0.0:1788748436.280843:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 269 00000100:00100000:0.0:1788748436.280849:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368640256:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748436.280884:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368640256:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748436.280890:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 269 00000100:00080000:0.0:1788748436.280933:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748436.280936:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748436.281551:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368640128 00000100:00100000:3.0:1788748436.281562:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368640128 00000100:00100000:3.0:1788748436.281631:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:3.0:1788748436.281640:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368640128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748436.281692:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368640128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 54us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748436.281699:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00080000:0.0:1788748436.282002:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748436.282523:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368639872 00000100:00100000:1.0:1788748436.282533:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368639872 00000100:00100000:1.0:1788748436.282598:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 378 00000100:00100000:1.0:1788748436.282608:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368639872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748436.282686:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368639872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748436.282694:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 378 00000100:00100000:0.0:1788748436.327004:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.327208:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368640512 00000100:00100000:2.0:1788748436.327220:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368640512 00000100:00080000:0.0:1788748436.327355:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748436.327457:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1788748436.327470:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:11222:x1875638368640512:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:2.0:1788748436.327502:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748436.327528:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a41f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c1d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327620:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327638:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327676:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327689:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327697:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327704:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327788:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327800:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 43 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327811:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327863:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 43 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.327881:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 43 pid: 8447 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748436.327896:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875638388647168:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748436.328034:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748436.331398:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748436.331944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368640768 00000100:00100000:3.0:1788748436.331973:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368640768 00000100:00100000:3.0:1788748436.332050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788748436.332071:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+44:6180:x1875638368640768:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788748436.332519:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+45:6180:x1875638368640768:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 456us (1130us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788748436.332528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788748436.335365:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748436.335810:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875638388647168:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748436.335845:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748436.336125:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368640896 00000100:00100000:2.0:1788748436.336135:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368640896 00010000:00010000:2.0:1788748436.336182:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 45 pid: 8447 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748436.336276:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788748436.336288:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+45:2411:x1875638368640896:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748436.336307:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748436.336341:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 45 pid: 8447 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.336356:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 45 pid: 8447 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.336382:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a3fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c0f expref: 45 pid: 8447 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.336403:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748436.336409:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.336421:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.336431:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.336462:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748436.337048:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337059:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748436.337135:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788748436.337142:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748436.337196:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337213:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337224:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337230:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337237:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337243:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748436.337248:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337267:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337280:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748436.337294:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748436.337300:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337307:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337355:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337362:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337369:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337375:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748436.337378:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337384:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337393:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:0.0:1788748436.337396:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748436.337399:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337405:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a42d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337446:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a41f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c1d expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337474:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c1d expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.337482:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748436.337485:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748436.337488:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd200, rc 0) 00000100:00100000:0.0:1788748436.337540:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+44:11222:x1875638368640512:12345-192.168.203.22@tcp:101:stat.0 Request processed in 10072us (10549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748436.337563:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1788748436.338871:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:2411:x1875638368640896:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 257us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748436.338886:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1788748436.399737:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748436.400031:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368641152 00000100:00100000:0.0:1788748436.400044:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368641152 00000100:00100000:0.0:1788748436.400233:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1788748436.400247:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:11228:x1875638368641152:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:0.0:1788748436.400360:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748436.400395:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c1d expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.400420:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748436.400427:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748436.400666:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.400683:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.400696:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748436.400765:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788748436.400790:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000534546eb reply state 000000004d8cd69e transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.400806:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.400814:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748436.400817:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788748436.400820:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748436.400986:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+45:11228:x1875638368641152:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 741us (1261us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788748436.400995:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000020:00080000:0.0:1788748436.401000:0:6512:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788748436.527706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748436.527904:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368641280 00000100:00100000:3.0:1788748436.527917:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368641280 00000100:00100000:3.0:1788748436.528040:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1788748436.528053:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+45:11242:x1875638368641280:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:3.0:1788748436.528087:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748436.528114:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a442 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c24 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528196:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528291:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528307:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528366:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528375:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528402:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528503:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528514:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528522:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748436.528681:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788748436.528687:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748436.528716:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528731:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528741:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528749:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528756:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528763:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748436.528768:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528785:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528801:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:3.0:1788748436.528804:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748436.528811:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528818:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a449 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528837:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528843:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528861:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528867:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748436.528870:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528877:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528885:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:3.0:1788748436.528887:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748436.528891:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528907:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528941:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a442 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 47 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528956:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 46 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.528964:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748436.528967:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748436.528970:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbac00, rc 0) 00000100:00100000:3.0:1788748436.529060:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+46:11242:x1875638368641280:12345-192.168.203.22@tcp:101:stat.0 Request processed in 1010us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748436.529070:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:1.0:1788748436.628032:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748436.628114:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368641536 00000100:00100000:0.0:1788748436.628128:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368641536 00000100:00100000:0.0:1788748436.628216:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:0.0:1788748436.628229:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+46:11252:x1875638368641536:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748436.628258:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748436.628283:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a45e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c2b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748436.628466:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788748436.628607:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a45e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c2b expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.628624:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:0.0:1788748436.628628:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748436.628652:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a45e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c2b expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.628669:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748436.628745:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+47:11252:x1875638368641536:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 518us (728us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788748436.628753:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:1.0:1788748436.634397:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748436.634724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368641792 00000100:00100000:3.0:1788748436.634738:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368641792 00000100:00100000:3.0:1788748436.634823:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1788748436.634837:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+47:11252:x1875638368641792:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788748436.635171:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+48:11252:x1875638368641792:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 336us (787us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788748436.635179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1788748436.698260:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748436.698396:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368642048 00000100:00100000:0.0:1788748436.698409:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368642048 00000100:00100000:0.0:1788748436.698492:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:0.0:1788748436.698504:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+48:11258:x1875638368642048:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748436.698536:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748436.698581:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a46c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.698717:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.698736:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 49 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.698747:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.698787:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 49 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.698803:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 49 pid: 10244 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748436.698842:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3928380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388647296:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748436.698968:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add96e6e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748436.702958:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3928380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388647296:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748436.703001:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748436.704284:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.704858:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368642176 00000100:00100000:2.0:1788748436.704871:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368642176 00010000:00010000:2.0:1788748436.704941:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 50 pid: 10244 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748436.704988:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1788748436.704998:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+50:2411:x1875638368642176:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748436.705016:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748436.705023:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 50 pid: 10244 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.705038:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 50 pid: 10244 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.705063:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a457 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c24 expref: 50 pid: 10244 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.705082:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748436.705088:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.705098:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.705106:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748436.705156:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748436.705223:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:2411:x1875638368642176:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 226us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748436.705231:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00010000:00010000:1.0:1788748436.706679:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.706698:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748436.706728:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788748436.706957:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a46c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.706981:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.706992:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748436.706995:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748436.706999:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148bc00, rc 0) 00000100:00100000:1.0:1788748436.707085:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:11258:x1875638368642048:12345-192.168.203.22@tcp:101:bash.0 Request processed in 8583us (8854us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788748436.707095:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1788748436.713627:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748436.713823:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368642432 00000100:00100000:3.0:1788748436.713836:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368642432 00000100:00100000:3.0:1788748436.713926:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:3.0:1788748436.713940:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:11258:x1875638368642432:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:3.0:1788748436.714261:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.714284:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.714297:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788748436.714393:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788748436.714419:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001abc50db reply state 000000002f9a8eb0 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.714435:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.714444:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748436.714447:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748436.714451:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748436.714885:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+52:11258:x1875638368642432:12345-192.168.203.22@tcp:36:bash.0 Request processed in 945us (1268us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788748436.714894:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000020:00080000:3.0:1788748436.714900:0:10244:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788748436.722776:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748436.723009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368642560 00000100:00100000:1.0:1788748436.723023:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368642560 00000100:00100000:1.0:1788748436.723108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:1.0:1788748436.723121:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+52:11258:x1875638368642560:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748436.723153:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748436.723180:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a488 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.723298:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.723360:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.723372:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.723419:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.723436:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 53 pid: 6512 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748436.723454:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388647424:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748436.723666:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add81370780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748436.728859:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748436.729400:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388647424:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748436.729437:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748436.729594:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368642688 00000100:00100000:3.0:1788748436.729604:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368642688 00010000:00010000:3.0:1788748436.729647:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 54 pid: 6512 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748436.729688:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:3.0:1788748436.729699:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:2410:x1875638368642688:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748436.729727:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748436.729736:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 54 pid: 6512 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.729751:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 54 pid: 6512 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.729777:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a473 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c32 expref: 54 pid: 6512 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.729805:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748436.729811:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.729822:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.729830:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.729869:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748436.730103:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:2410:x1875638368642688:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 404us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748436.730112:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00010000:00010000:1.0:1788748436.730483:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.730494:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748436.730563:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788748436.730569:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748436.730594:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.730634:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a488 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c39 expref: 53 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.730653:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c39 expref: 52 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.730662:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748436.730665:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748436.730668:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69c00, rc 0) 00000100:00100000:1.0:1788748436.730709:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+52:11258:x1875638368642560:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7591us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748436.730718:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:1.0:1788748436.738882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748436.739100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368642944 00000100:00100000:3.0:1788748436.739114:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368642944 00000100:00100000:3.0:1788748436.739186:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1788748436.739197:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda703ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+52:11258:x1875638368642944:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1788748436.739534:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda703ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:11258:x1875638368642944:12345-192.168.203.22@tcp:35:bash.0 Request processed in 338us (666us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788748436.739555:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788748436.831636:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748436.831765:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368643200 00000100:00100000:1.0:1788748436.831861:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368643200 00000100:00100000:1.0:1788748436.832050:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:1.0:1788748436.832063:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:11268:x1875638368643200:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748436.832119:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748436.832146:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c40 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748436.832286:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788748436.832477:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a496 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c40 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.832494:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:1.0:1788748436.832498:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748436.832505:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c40 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.832520:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68600, rc 0) 00000100:00100000:1.0:1788748436.832598:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11268:x1875638368643200:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 538us (976us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788748436.832605:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1788748436.835565:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748436.835701:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368643328 00000100:00100000:3.0:1788748436.835714:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368643328 00000100:00100000:3.0:1788748436.835794:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1788748436.835806:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11268:x1875638368643328:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1788748436.835930:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.835952:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.835966:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.835979:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.835986:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.835993:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836095:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836106:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836134:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748436.836192:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836207:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836214:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836222:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836229:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748436.836234:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836242:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836255:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:3.0:1788748436.836259:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748436.836265:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836272:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a4a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836288:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836300:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836306:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836311:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748436.836362:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836371:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836379:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:3.0:1788748436.836382:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748436.836385:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836390:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a4ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836402:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836409:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836420:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836426:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbac00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748436.836435:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836442:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836449:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748436.836452:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748436.836454:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748436.836460:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a4b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748436.836565:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11268:x1875638368643328:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 760us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748436.836574:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00010000:00010000:0.0:1788748436.838355:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748436.841610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748436.841903:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368643584 00000100:00100000:1.0:1788748436.841967:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368643584 00000100:00100000:1.0:1788748436.842042:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788748436.842053:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11268:x1875638368643584:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748436.842610:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+55:11268:x1875638368643584:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 556us (1072us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788748436.842620:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788748436.882155:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748436.882273:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368643840 00000100:00100000:1.0:1788748436.882285:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368643840 00000100:00100000:1.0:1788748436.882383:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:1.0:1788748436.882410:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+55:11271:x1875638368643840:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748436.882445:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748436.882471:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a4b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c47 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882580:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882599:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882611:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882623:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882630:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882637:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882775:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a4ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882785:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a4ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882793:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a4ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748436.882816:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788748436.882926:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882934:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882942:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882949:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68c00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748436.882953:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882960:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882973:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748436.882976:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748436.882981:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.882987:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a4c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883003:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883009:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883025:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883030:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748436.883033:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883039:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883047:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:1.0:1788748436.883050:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748436.883064:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883071:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a4c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883119:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a4b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c47 expref: 58 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883133:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a4ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c47 expref: 57 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.883140:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748436.883142:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748436.883145:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69e00, rc 0) 00000100:00100000:1.0:1788748436.883230:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:11271:x1875638368643840:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 821us (1088us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788748436.883246:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1788748436.886509:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748436.886597:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748436.886724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368644096 00000100:00100000:0.0:1788748436.886736:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368644096 00000100:00100000:0.0:1788748436.886803:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:0.0:1788748436.886813:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:11271:x1875638368644096:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788748436.886909:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.886931:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.886946:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.886991:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.886999:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.887028:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.887035:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748436.887040:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.887049:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.887062:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748436.887066:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748436.887071:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748436.887079:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748436.887162:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:11271:x1875638368644096:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 350us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748436.887170:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:1.0:1788748436.889216:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368643968 00000100:00100000:1.0:1788748436.889231:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368643968 00000100:00100000:1.0:1788748436.889334:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1788748436.889347:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:2413:x1875638368643968:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748436.889365:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748436.889394:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a4ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c47 expref: 57 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748436.889417:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748436.889422:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748436.890689:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:2413:x1875638368643968:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1332us (4183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748436.890705:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1788748436.894731:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748436.894819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368644352 00000100:00100000:1.0:1788748436.894833:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368644352 00000100:00100000:1.0:1788748436.894922:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1788748436.894934:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:11271:x1875638368644352:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748436.895263:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:11271:x1875638368644352:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 330us (544us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788748436.895272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1788748437.093176:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748437.093306:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368644608 00000100:00100000:0.0:1788748437.093338:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368644608 00000100:00100000:0.0:1788748437.093434:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1788748437.093445:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:11289:x1875638368644608:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1788748437.093491:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748437.093519:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c4e expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.093997:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a4ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.094015:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a4ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.094030:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a4ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748437.094044:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788748437.094199:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a4e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c4e expref: 60 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.094223:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a4ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c4e expref: 59 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.094232:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748437.094235:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788748437.094239:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748437.094313:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:11289:x1875638368644608:12345-192.168.203.22@tcp:101:cat.0 Request processed in 869us (1150us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788748437.094364:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000001:00080000:2.0:1788748437.100853:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:2.0:1788748437.100935:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788748437.100960:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8addb3a53480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788748437.100966:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8addba6d2c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8addb3a53b40 00000020:00080000:2.0:1788748437.100969:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8addba6d2a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8add84dd7e00 00010000:00010000:0.0:1788748437.101073:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101088:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101097:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101127:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748437.101133:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101142:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101162:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8addba6a8700) 00010000:00010000:0.0:1788748437.101164:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748437.101170:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101176:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a2c8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101201:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101207:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101213:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101217:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748437.101220:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101226:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101245:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748437.101248:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748437.101251:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101257:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a2cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101275:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101282:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101288:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101293:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748437.101296:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101302:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101309:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1e00) 00010000:00010000:0.0:1788748437.101312:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748437.101314:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101361:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1a30e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101390:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101396:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101402:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101408:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748437.101411:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101417:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101426:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748437.101428:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748437.101431:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101437:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a418 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101447:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101467:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101473:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101486:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748437.101489:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101495:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101503:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748437.101506:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748437.101508:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101514:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a43b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101525:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101530:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101545:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101550:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbbe00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748437.101553:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101560:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101577:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748437.101580:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748437.101583:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.101589:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a481 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748437.102231:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748437.102257:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388647552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788748437.102382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748437.103698:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388647552 00000100:00100000:1.0:1788748437.103713:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388647552 00000100:00100000:1.0:1788748437.103801:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748437.103815:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388647552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788748437.103882:0:8734:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788748437.103926:0:8734:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9e2293, atime: 0x6a9e2293, ctime: 0x6a9e2293, blocks: 0x8 00010000:00010000:1.0:1788748437.103935:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.103955:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1788748437.103960:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748437.103967:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.103985:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.103997:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.104005:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.104024:0:8734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788748437.104228:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388647552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 417us (1846us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788748437.104236:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:3.0:1788748437.104548:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788748437.104733:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788748437.105287:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748437.105299:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.105313:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69e00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748437.105345:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.105376:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.105412:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.105422:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c271fbe0/0x9ba0f20a02e1a4f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.105663:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748437.105666:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748437.105668:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788748437.105679:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788748437.105737:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8addbc908700/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788748437.105747:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388647552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788748437.125001:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748437.125113:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368644736 00000100:00100000:1.0:1788748437.125125:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368644736 00000100:00100000:1.0:1788748437.125201:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:1.0:1788748437.125214:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11290:x1875638368644736:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748437.125273:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748437.125299:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a4ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c55 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.125437:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a506 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.125565:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.125581:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748437.125638:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788748437.125643:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748437.125667:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a506 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.125699:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a4ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c55 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.125721:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a506 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c55 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748437.125730:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748437.125733:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748437.125737:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69000, rc 0) 00000100:00100000:1.0:1788748437.125822:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11290:x1875638368644736:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 610us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748437.125830:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:2.0:1788748437.136378:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748437.136899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368645120 00000100:00100000:1.0:1788748437.136914:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368645120 00000100:00100000:1.0:1788748437.136996:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788748437.137008:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11290:x1875638368645120:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748437.137442:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11290:x1875638368645120:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 435us (1128us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788748437.138643:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1788748437.142369:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748437.142506:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368645248 00000100:00100000:0.0:1788748437.142519:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368645248 00000100:00100000:0.0:1788748437.142605:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:0.0:1788748437.142618:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11290:x1875638368645248:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:0.0:1788748437.142638:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788748437.142671:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a48f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c39 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.142698:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a4ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c4e expref: 14 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.142712:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a38c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bf3 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748437.142725:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748437.142731:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748437.142821:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:11290:x1875638368645248:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 205us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748437.142829:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1788748437.146943:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748437.147101:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368645376 00000100:00100000:3.0:1788748437.147113:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368645376 00000100:00100000:3.0:1788748437.147186:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:3.0:1788748437.147199:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:11290:x1875638368645376:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:3.0:1788748437.147403:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.147435:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.147721:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748437.148161:0:10244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748437.148367:0:10244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788748437.148889:0:10244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788748437.149027:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:11290:x1875638368645376:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 1826us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748437.149039:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:1.0:1788748437.173460:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748437.176049:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368645504 00000100:00100000:3.0:1788748437.176144:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368645504 00000100:00100000:2.0:1788748437.176442:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:2.0:1788748437.176455:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:11292:x1875638368645504:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748437.176501:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748437.176526:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc600/0x9ba0f20a02e1a514 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c5c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176628:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176647:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176661:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176678:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176685:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176692:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176972:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176984:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.176992:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748437.177048:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788748437.177060:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748437.177088:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177103:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177113:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177119:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177126:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177133:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748437.177138:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177147:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177165:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748437.177168:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748437.177176:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177183:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a51b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177200:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177214:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177221:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177225:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bde00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748437.177228:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177234:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177243:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adc8259cf00) 00010000:00010000:2.0:1788748437.177245:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748437.177247:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177253:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a522 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177289:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc600/0x9ba0f20a02e1a514 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177302:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748437.177309:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748437.177312:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748437.177934:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd800, rc 0) 00000100:00100000:2.0:1788748437.178030:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11292:x1875638368645504:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1575us (4581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748437.178039:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:1.0:1788748437.288168:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748437.288520:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388647680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748437.288624:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748437.288658:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388647680 00000100:00100000:3.0:1788748437.288670:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388647680 00000100:00100000:0.0:1788748437.289077:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788748437.289093:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388647680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748437.289140:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788748437.289207:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388647680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748437.289214:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788748437.289553:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388647680:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788748437.862379:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788748437.933888:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748437.933904:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748437.933973:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788748437.934006:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748437.935864:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc909c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388647808:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788748437.936000:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add811cac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748437.945468:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc909c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388647808:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748437.954649:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748437.954722:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368645632 00000100:00100000:2.0:1788748437.954735:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368645632 00000100:00100000:2.0:1788748437.954808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:2.0:1788748437.954822:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11303:x1875638368645632:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748437.954879:0:6512:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748437.955037:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11303:x1875638368645632:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 217us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748437.955045:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:2.0:1788748437.968260:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748437.969405:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368645760 00000100:00100000:3.0:1788748437.969425:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368645760 00000100:00100000:3.0:1788748437.969514:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:3.0:1788748437.969526:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11303:x1875638368645760:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788748437.969624:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969645:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969659:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969757:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969766:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969773:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969808:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969827:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.969835:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748437.969974:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788748437.969979:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748437.969995:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970008:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970015:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970023:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970031:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748437.970036:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970044:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970209:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:3.0:1788748437.970213:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748437.970220:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970238:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a530 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970255:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970261:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970267:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970517:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748437.970521:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970528:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970537:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8add864c2b00) 00010000:00010000:3.0:1788748437.970540:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748437.970543:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970550:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a537 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970569:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970575:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970588:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970593:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748437.970597:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970603:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970611:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748437.970614:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748437.970617:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.970623:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a53e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748437.970724:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11303:x1875638368645760:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 1197us (2471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748437.970733:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:2.0:1788748437.983128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748437.983274:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368646016 00000100:00100000:3.0:1788748437.983287:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368646016 00000100:00100000:3.0:1788748437.983388:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:3.0:1788748437.983410:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11303:x1875638368646016:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748437.983447:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748437.983473:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a545 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c63 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983632:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983650:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983663:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748437.983677:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788748437.983785:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983793:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983801:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983807:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748437.983812:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983820:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983834:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748437.983837:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748437.983855:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983873:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a54c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983928:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a545 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c63 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983939:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:3.0:1788748437.983942:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748437.983946:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a545 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c63 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748437.983956:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb000, rc 0) 00000100:00100000:3.0:1788748437.984035:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368646016:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 637us (921us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788748437.984044:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:0.0:1788748437.999085:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748437.999193:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368646144 00000100:00100000:1.0:1788748437.999207:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368646144 00000100:00100000:1.0:1788748437.999295:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:1.0:1788748437.999309:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb392aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368646144:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788748437.999381:0:8447:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788748437.999782:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb392aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368646144:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 473us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748437.999791:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:1.0:1788748438.006790:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748438.007001:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368646400 00000100:00100000:3.0:1788748438.007015:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368646400 00000100:00100000:3.0:1788748438.008504:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:3.0:1788748438.008523:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368646400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748438.008551:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748438.008555:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788748438.008589:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a506 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c55 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.008610:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:3.0:1788748438.008616:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748438.008643:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a55a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c6a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748438.009172:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788748438.009376:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a561 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.009395:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.009408:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.009475:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a55a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c6a expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.009496:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c6a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.009504:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8add864c2b00) 00010000:00010000:3.0:1788748438.009507:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748438.009510:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bba200, rc 0) 00000100:00100000:3.0:1788748438.009601:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11303:x1875638368646400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1084us (2825us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788748438.009610:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00080000:0.0:1788748438.014218:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748438.021362:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.022578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368646656 00000100:00100000:0.0:1788748438.022595:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368646656 00000100:00100000:0.0:1788748438.023619:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:0.0:1788748438.023636:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11303:x1875638368646656:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748438.023717:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748438.023754:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a561 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c6a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.023778:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8add864c2b00) 00010000:00010000:0.0:1788748438.023793:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748438.023823:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.023867:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.023881:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.027203:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.027248:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028366:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028424:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028433:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028440:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028448:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748438.028453:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028463:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028477:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748438.028481:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748438.028487:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028493:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a56f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028512:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028532:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028538:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028544:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748438.028547:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028553:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028562:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7262e80e (ffff8adda17e1c00) 00010000:00010000:0.0:1788748438.028564:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748438.028568:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.028573:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a576 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7262e80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748438.028708:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368646656:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 5073us (7392us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748438.028717:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:1.0:1788748438.040002:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000040:00080000:2.0:1788748438.043498:0:14199:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748438.043510:0:14199:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748438.043539:0:14199:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788748438.043549:0:14199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748438.045772:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368646784 00000100:00100000:3.0:1788748438.045792:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368646784 00000100:00100000:0.0:1788748438.045959:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:0.0:1788748438.045980:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368646784:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748438.046002:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748438.046373:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a57d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c71 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.046441:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.046457:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.046471:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.046607:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a57d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 16 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.046628:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 15 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.046639:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748438.046643:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748438.046646:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:0.0:1788748438.046725:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11303:x1875638368646784:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 751us (6738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748438.055825:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:3.0:1788748438.057341:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.057392:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368647040 00000100:00100000:0.0:1788748438.057407:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368647040 00000100:00100000:0.0:1788748438.057479:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:0.0:1788748438.057489:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11303:x1875638368647040:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748438.057574:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.057611:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.057623:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748438.057801:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788748438.057814:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355044496032ns, next at 356044493475ns, rc = 0 00000004:00010000:0.0:1788748438.057878:0:6511:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000012d275db reply state 00000000b7c06bae transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.057891:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.057898:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748438.057901:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788748438.057905:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748438.058017:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:11303:x1875638368647040:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 528us (704us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788748438.058024:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:1.0:1788748438.063092:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.063210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368647168 00000100:00100000:0.0:1788748438.063221:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368647168 00000100:00100000:0.0:1788748438.063288:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:0.0:1788748438.063298:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:11303:x1875638368647168:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748438.063383:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748438.063639:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c78 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.063725:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.063739:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.063758:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748438.063761:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748438.063765:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748438.063824:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:11303:x1875638368647168:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 527us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748438.063834:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:1.0:1788748438.070545:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748438.070617:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368647296 00000100:00100000:3.0:1788748438.070635:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368647296 00000100:00100000:3.0:1788748438.070715:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:3.0:1788748438.070724:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2409:x1875638368647296:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788748438.070768:0:8427:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1788748438.070812:0:8427:0:(genops.c:1384:class_connect()) connect: client 53dfbad0-5125-4663-8fa7-3e1aae0338a8, cookie 0x9ba0f20a02e1a599 00002000:00100000:3.0:1788748438.070847:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 53dfbad0-5125-4663-8fa7-3e1aae0338a8/ffff8add85231800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788748438.070874:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788748438.070976:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788748438.071022:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8add852ab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748438.071117:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2409:x1875638368647296:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 Request processed in 392us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748438.071126:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:3.0:1788748438.075469:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748438.075517:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368647424 00000100:00100000:3.0:1788748438.075541:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368647424 00000100:00100000:3.0:1788748438.075625:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1788748438.075637:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:0:x1875638368647424:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788748438.075835:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788748438.083576:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1788748438.083596:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000100:00100000:1.0:1788748438.086986:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:0:x1875638368647424:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 11337us (11516us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788748438.087003:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:1.0:1788748438.104875:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.104990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368647680 00000100:00100000:0.0:1788748438.105005:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368647680 00000100:00100000:0.0:1788748438.105073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788748438.105085:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:11303:x1875638368647680:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788748438.105407:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11303:x1875638368647680:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 322us (543us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788748438.105417:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788748438.122601:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748438.122706:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368647936 00000100:00100000:3.0:1788748438.122719:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368647936 00000100:00100000:3.0:1788748438.122793:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1788748438.122805:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11303:x1875638368647936:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748438.122966:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11303:x1875638368647936:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 162us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748438.122983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:0.0:1788748438.133124:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748438.133257:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368648064 00000100:00100000:3.0:1788748438.133281:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368648064 00000100:00100000:3.0:1788748438.133378:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:3.0:1788748438.133390:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11303:x1875638368648064:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748438.133419:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748438.133447:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c7f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.133532:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a5a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.133549:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.133562:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748438.133633:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748438.133657:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.133690:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c7f expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.133712:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c7f expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.133721:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:3.0:1788748438.133738:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788748438.133743:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb800, rc 0) 00000100:00100000:3.0:1788748438.133824:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11303:x1875638368648064:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 436us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748438.133832:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1788748438.141002:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748438.154670:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368648192 00000100:00100000:2.0:1788748438.154694:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368648192 00000100:00100000:3.0:1788748438.154923:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1788748438.154937:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368648192:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748438.154956:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748438.155185:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c86 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748438.155214:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e2296, blocks: 0x0 00010000:00010000:3.0:1788748438.155235:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788748438.155239:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748438.155249:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.155269:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.155281:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bba200, rc 0) 00000100:00100000:3.0:1788748438.155874:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368648192:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 937us (14880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748438.155887:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:2.0:1788748438.163031:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.163092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368648448 00000100:00100000:0.0:1788748438.163106:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368648448 00000100:00100000:0.0:1788748438.163248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:0.0:1788748438.163261:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11303:x1875638368648448:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788748438.163474:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11303:x1875638368648448:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 214us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748438.163492:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:2.0:1788748438.183350:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.184378:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368648576 00000100:00100000:0.0:1788748438.184400:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368648576 00000100:00100000:0.0:1788748438.184468:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:0.0:1788748438.184480:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:11303:x1875638368648576:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748438.184499:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748438.184527:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c8d expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.184561:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.184570:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748438.184574:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748438.184579:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.184617:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.184631:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 7 pid: 8425 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748438.184646:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388647936:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748438.184745:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748438.190873:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748438.191175:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388647936:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748438.191236:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.191265:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a800, rc 0) 00000100:00100000:1.0:1788748438.191386:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:11303:x1875638368648576:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 6906us (8072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748438.191396:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1788748438.191924:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368648704 00000100:00100000:2.0:1788748438.191935:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368648704 00010000:00010000:2.0:1788748438.191980:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 7 pid: 8425 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748438.192023:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1788748438.192034:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368648704:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748438.192052:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748438.192078:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 7 pid: 8425 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.192092:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 7 pid: 8425 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.192122:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a5ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c86 expref: 7 pid: 8425 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.192137:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748438.192204:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748438.192280:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 6 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.192292:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 6 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.192373:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 6 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748438.192389:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6497:1875638388648064:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788748438.192564:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21540 going to sleep for 11 seconds 00000100:00100000:2.0:1788748438.205541:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6497:1875638388648064:192.168.203.22@tcp:105: 00010000:00010000:2.0:1788748438.205578:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748438.205675:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368648704:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 13640us (14809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748438.205688:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1788748438.215217:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.215982:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368648832 00000100:00100000:0.0:1788748438.215993:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368648832 00002000:00100000:0.0:1788748438.216037:0:8432:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8adc840bb100 x1875638368648832/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:184/0 lens 504/0 e 0 to 0 dl 1788748449 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748438.216049:0:8432:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc840bb100 with x1875638368648832 ext(0->8) 00002000:00010000:0.0:1788748438.217504:0:8432:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc840bb100 00000100:00100000:0.0:1788748438.217730:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1788748438.217745:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368648832:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788748438.220477:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368648832:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 2728us (5259us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788748438.220491:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:0.0:1788748438.220503:0:8432:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8adc840bb100 x1875638368648832/t4294967303(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:184/0 lens 504/448 e 0 to 0 dl 1788748449 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748438.220522:0:8432:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc840bb100 with x1875638368648832 ext(0->8) 00002000:00010000:0.0:1788748438.220529:0:8432:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc840bb100 00000100:00100000:3.0:1788748438.227832:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.227920:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368648960 00000100:00100000:0.0:1788748438.227929:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368648960 00000100:00100000:0.0:1788748438.227979:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:0.0:1788748438.227988:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11303:x1875638368648960:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788748438.239390:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788748438.239421:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:2.0:1788748438.239434:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.239456:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.239464:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.239472:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a400 already unused, calling callback (ffffffffc191c4f0) 00000020:00080000:1.0:1788748438.239473:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1788748438.239479:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.239491:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788748438.239505:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1788748438.239522:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00000020:00080000:1.0:1788748438.239525:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1788748438.239529:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748438.239535:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.239544:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a58b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.239718:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368648960:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 11723us (11889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748438.239733:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:1.0:1788748438.239870:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388648192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788748438.239937:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748438.240017:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388648192 00000100:00100000:2.0:1788748438.240024:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388648192 00000100:00100000:2.0:1788748438.240295:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748438.240304:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388648192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788748438.241655:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788748438.241663:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788748439 00002000:00010000:2.0:1788748438.241666:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788748438.241668:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788748438 -> 1788748439 00002000:00010000:2.0:1788748438.241670:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:3.0:1788748438.242427:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748438.249494:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388648192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 9180us (9546us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788748438.249573:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788748438.249621:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748438.249870:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368649088 00000100:00100000:2.0:1788748438.249878:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368649088 00000100:00100000:2.0:1788748438.249928:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:2.0:1788748438.249937:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368649088:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788748438.252821:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8add812ace00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788748438.252836:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388648192:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788748438.258273:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788748438.258289:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788748438.258768:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368649088:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 8820us (9146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748438.258784:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1788748438.271680:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748438.272290:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368649344 00000100:00100000:1.0:1788748438.272303:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368649344 00000100:00100000:1.0:1788748438.272395:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:1.0:1788748438.274423:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368649344:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788748438.274499:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748438.274659:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a5a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c7f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.274685:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:1.0:1788748438.274691:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748438.274740:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.274755:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.274766:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748438.274967:0:8447:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004e3a5ff9 reply state 00000000874f5d39 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.274982:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.275010:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:1.0:1788748438.275013:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748438.275017:0:8447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748438.276376:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11303:x1875638368649344:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1977us (4698us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788748438.285912:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:1.0:1788748438.286137:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748438.286367:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368649472 00000100:00100000:1.0:1788748438.286380:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368649472 00000100:00100000:1.0:1788748438.286516:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1788748438.286527:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368649472:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788748438.286967:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788748438.286972:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788748439 -> 1788748437 00002000:00010000:1.0:1788748438.286975:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788748435 00002000:00010000:1.0:1788748438.286978:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788748439 -> 1788748437 00002000:00010000:1.0:1788748438.286981:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788748438.287973:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368649472:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 1438us (1829us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788748438.287990:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1788748438.292011:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748438.292116:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368649728 00000100:00100000:1.0:1788748438.292129:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368649728 00000100:00100000:1.0:1788748438.292209:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:1.0:1788748438.292228:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:11303:x1875638368649728:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788748438.292337:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.292374:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 15 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.292384:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.292438:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 15 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.292456:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 15 pid: 8447 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.292473:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388648320:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748438.292596:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add811cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748438.300068:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388648320:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748438.300115:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748438.302653:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.302965:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368649856 00000100:00100000:0.0:1788748438.302981:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368649856 00010000:00010000:0.0:1788748438.303029:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 16 pid: 8447 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748438.303150:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1788748438.303176:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:2410:x1875638368649856:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748438.303192:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748438.303199:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 16 pid: 8447 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.303213:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 16 pid: 8447 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.303257:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c71 expref: 16 pid: 8447 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.303273:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748438.303277:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.303287:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.303295:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.303361:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748438.303372:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.303386:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748438.303427:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:2410:x1875638368649856:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 253us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748438.303436:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00010000:00010000:1.0:1788748438.303697:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.303708:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.303729:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.303737:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748438.303743:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.303752:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.303769:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:1.0:1788748438.303772:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788748438.303777:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.303785:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a5c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.303873:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368649728:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 11644us (11874us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788748438.303884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:1.0:1788748438.307490:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748438.307535:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368649984 00000100:00100000:1.0:1788748438.307547:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368649984 00000100:00100000:1.0:1788748438.307612:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1788748438.307625:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368649984:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788748438.307684:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.307728:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.307738:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748438.307742:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748438.307747:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.307792:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.307809:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 7 pid: 8424 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.307827:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388648448:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748438.309029:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a53480 going to sleep for 11 seconds 00000100:00100000:1.0:1788748438.323575:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748438.323607:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368650112 00000100:00100000:1.0:1788748438.323616:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368650112 00010000:00010000:1.0:1788748438.323654:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 8 pid: 8424 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.323697:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1788748438.323706:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368650112:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748438.323721:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748438.323749:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 8 pid: 8424 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.323765:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 8 pid: 8424 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.323791:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748438.323796:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748438.323801:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.323811:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.323832:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748438.323892:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368650112:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 185us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748438.323899:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00010000:00010000:1.0:1788748438.323945:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1a5b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c8d expref: 7 pid: 8424 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.323959:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388648448:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748438.323977:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.323988:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.324007:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.324025:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.324034:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.324042:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.324049:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748438.324053:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.325914:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.325951:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.325961:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000107bd299/0x9ba0f20a02e1a5ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.326055:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368649984:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 18429us (18574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748438.326486:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1788748438.338176:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748438.338420:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368650368 00000100:00100000:1.0:1788748438.338431:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368650368 00000100:00100000:1.0:1788748438.338494:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:1.0:1788748438.338505:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11303:x1875638368650368:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788748438.338583:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.338601:0:10244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.338612:0:10244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.338647:0:10244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.338662:0:10244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 14 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.338677:0:10244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388648576:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748438.338764:0:10244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add811cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748438.363584:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.363699:0:10244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388648576:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748438.363728:0:10244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748438.365244:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368650496 00000100:00100000:2.0:1788748438.365256:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368650496 00010000:00010000:2.0:1788748438.365303:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 15 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748438.365387:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:2.0:1788748438.365397:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:2411:x1875638368650496:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748438.365411:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748438.365430:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 15 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.365444:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 15 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.365467:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a411 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c16 expref: 15 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.365485:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748438.365491:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.365500:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.365508:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.365530:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748438.365597:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:2411:x1875638368650496:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 201us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748438.365605:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00010000:00010000:0.0:1788748438.365710:0:10244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.365719:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.365894:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.365907:0:10244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.365915:0:10244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.365956:0:10244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.365969:0:10244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 14 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748438.365981:0:10244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388648704:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748438.366038:0:10244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748438.374457:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.374565:0:10244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388648704:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748438.374592:0:10244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.374666:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368650624 00000100:00100000:1.0:1788748438.374687:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368650624 00010000:00010000:1.0:1788748438.374724:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 15 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748438.374790:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:1.0:1788748438.374800:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:2410:x1875638368650624:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748438.374816:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748438.374823:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 15 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.374835:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 15 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.374887:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a592 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c78 expref: 15 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.374904:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:1.0:1788748438.374909:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.374918:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.374925:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748438.375445:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748438.376140:0:10244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.376165:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748438.376234:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:2410:x1875638368650624:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1431us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748438.376243:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000001:00080000:0.0:1788748438.376268:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788748438.376396:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788748438.376429:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788748438.377067:0:10244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10244:1875638388648832:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788748438.377134:0:10244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748438.377182:0:10244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748438.377808:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388648832 00000100:00100000:0.0:1788748438.377817:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388648832 00000100:00100000:0.0:1788748438.377914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788748438.377925:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10244:x1875638388648832:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788748438.378050:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10244:x1875638388648832:12345-0@lo:1000:mdt00_004.0 Request processed in 127us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748438.378057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788748438.378134:0:10244:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788748438.378140:0:10244:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8add812ace00, transno 4294967304 00000100:00100000:3.0:1788748438.378154:0:10244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10244:1875638388648832:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788748438.378296:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788748438.378378:0:10244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10244:1875638388648960:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788748438.378430:0:10244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748438.378787:0:10244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788748438.378931:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388648960 00000100:00100000:1.0:1788748438.378936:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388648960 00000100:00100000:1.0:1788748438.378977:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788748438.378992:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10244:x1875638388648960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788748438.379115:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10244:x1875638388648960:12345-0@lo:1000:mdt00_004.0 Request processed in 124us (685us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788748438.379122:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788748438.379358:0:10244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10244:1875638388648960:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788748438.379394:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379405:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379412:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379418:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748438.379422:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379430:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379453:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:3.0:1788748438.379456:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748438.379462:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379469:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a5d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379501:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379508:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379515:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379520:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbac00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748438.379524:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379530:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379539:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748438.379541:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748438.379545:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379551:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a50d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379586:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379601:0:10244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379610:0:10244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379636:0:10244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.379649:0:10244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 17 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748438.379661:0:10244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388649088:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748438.379729:0:10244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add82fc73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748438.402292:0:10244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388649088:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748438.402362:0:10244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748438.405352:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.405444:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368650752 00000100:00100000:0.0:1788748438.405454:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368650752 00010000:00010000:0.0:1788748438.405493:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 18 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748438.405536:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1788748438.405546:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:2413:x1875638368650752:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748438.405561:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748438.405568:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 18 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.405583:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 18 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.405622:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a529 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c5c expref: 18 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.405639:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748438.405645:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.405654:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.405662:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.405693:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748438.405751:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:2413:x1875638368650752:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 206us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748438.405758:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00010000:00010000:3.0:1788748438.406035:0:10244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406046:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406119:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406135:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406142:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406147:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748438.406152:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406160:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406170:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748438.406173:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748438.406177:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406184:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a5df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406196:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406201:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406206:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406210:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748438.406218:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406224:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406232:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748438.406235:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788748438.406238:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748438.406243:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a5d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748438.407491:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748438.407499:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748438.407519:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788748438.407527:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748438.407541:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11303:x1875638368650368:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 69031us (69367us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788748438.407553:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000020:00080000:3.0:1788748438.407559:0:10244:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788748438.409621:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748438.414566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368651008 00000100:00100000:0.0:1788748438.414583:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368651008 00000100:00100000:0.0:1788748438.414689:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1788748438.414702:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11303:x1875638368651008:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788748438.414994:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788748438.415030:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788748438.415069:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.415087:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.415116:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.415126:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.415133:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.415139:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748438.415164:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788748438.415271:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:11303:x1875638368651008:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 571us (5657us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788748438.415279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000020:00080000:0.0:1788748438.415284:0:6514:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788748438.417749:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748438.417764:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.417775:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748438.417779:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.417790:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.417808:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:2.0:1788748438.417811:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788748438.417816:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.417822:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a5e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748438.417850:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748438.417853:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748438.417855:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748438.884484:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748439.332603:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748439.332634:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388649216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748439.332727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748439.332854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388649216 00000100:00100000:3.0:1788748439.332864:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388649216 00000100:00100000:3.0:1788748439.332927:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788748439.332940:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388649216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788748439.332990:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748439.333862:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388649216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 854us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748439.333875:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788748439.339755:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388649216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748439.848669:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388649344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748439.848769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748439.848943:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748439.848951:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388649472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748439.848980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748439.849166:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388649600:0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.849208:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748439.849220:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388649344 00000100:00100000:2.0:1788748439.849233:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388649344 00000100:00080000:3.0:1788748439.849288:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748439.849303:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388649728:0@lo:400:kworker.0 00000100:00100000:2.0:1788748439.849346:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388649472 00000100:00100000:2.0:1788748439.849351:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388649472 00000100:00100000:3.0:1788748439.849366:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748439.849386:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788748439.849398:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875638388649344:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788748439.849401:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788748439.849437:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748439.849442:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388649856:0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.849481:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748439.849500:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875638388649344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748439.849508:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788748439.849528:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788748439.849534:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388649472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748439.849544:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748439.849566:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388649472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748439.849572:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788748439.850276:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388649728 00000100:00100000:1.0:1788748439.850284:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388649728 00000100:00100000:1.0:1788748439.850457:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788748439.850468:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388649728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.850540:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388649728:12345-0@lo:400:kworker.0 Request processed in 75us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748439.850547:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788748439.850597:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388649728:0@lo:400:kworker.0 00000100:00100000:0.0:1788748439.850797:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388649600 00000100:00100000:0.0:1788748439.850804:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388649600 00000100:00100000:0.0:1788748439.850852:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788748439.850860:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388649600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748439.850916:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388649600:12345-0@lo:400:kworker.0 Request processed in 57us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748439.850922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788748439.853394:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388649344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748439.853478:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388649472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748439.853927:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8408ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388649600:0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.854072:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388649856 00000100:00100000:3.0:1788748439.854082:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388649856 00000100:00100000:3.0:1788748439.854154:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788748439.854165:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388649856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.854291:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388649856:12345-0@lo:400:kworker.0 Request processed in 126us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748439.854299:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788748439.854365:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388649856:0@lo:400:kworker.0 00000100:00100000:2.0:1788748439.856582:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388649984:0@lo:400:kworker.0 00000100:00100000:2.0:1788748439.856665:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748439.856760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388649984 00000100:00100000:1.0:1788748439.856770:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388649984 00000100:00100000:1.0:1788748439.856841:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788748439.856852:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388649984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.856918:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388649984:12345-0@lo:400:kworker.0 Request processed in 68us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748439.856926:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788748439.856978:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388649984:0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.858115:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388650112:0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.858183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748439.858274:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388650112 00000100:00100000:2.0:1788748439.858282:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388650112 00000100:00100000:3.0:1788748439.858329:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748439.858358:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388650240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748439.858375:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788748439.858391:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748439.858392:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388650112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.858427:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388650240 00000100:00100000:3.0:1788748439.858433:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388650240 00000100:00100000:2.0:1788748439.858463:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388650112:12345-0@lo:400:kworker.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748439.858471:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788748439.858481:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388650240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.859620:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388650240:12345-0@lo:400:kworker.0 Request processed in 1132us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748439.859692:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788748439.859865:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:3.0:1788748439.859895:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748439.859901:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788748439.859951:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc843f1180 x1875638388650240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748439.859971:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388650240:0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.859984:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388650112:0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.860503:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388650368:0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.860571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748439.860640:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388650368 00000100:00100000:3.0:1788748439.860648:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388650368 00000100:00100000:3.0:1788748439.860704:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788748439.860715:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388650368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.861202:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388650368:0@lo:400:kworker.0 00000100:00100000:3.0:1788748439.861203:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388650368:12345-0@lo:400:kworker.0 Request processed in 489us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748439.861217:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788748439.861237:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748439.861245:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388650496:0@lo:400:kworker.0 00000100:00080000:3.0:1788748439.861248:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748439.861288:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748439.861417:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388650496 00000100:00100000:0.0:1788748439.861423:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388650496 00000100:00100000:0.0:1788748439.861456:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788748439.861471:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388650496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748439.861518:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388650496:12345-0@lo:400:kworker.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748439.861524:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788748439.861557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388650496:0@lo:400:kworker.0 00000100:00100000:0.0:1788748439.861879:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388650624:0@lo:400:kworker.0 00000100:00100000:0.0:1788748439.861915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748439.861972:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388650624 00000100:00100000:1.0:1788748439.861977:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388650624 00000100:00100000:1.0:1788748439.862021:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788748439.862028:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388650624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.862135:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388650624:12345-0@lo:400:kworker.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748439.862142:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:1.0:1788748439.862160:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748439.862171:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388650752:0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.862195:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748439.862235:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388650752 00000100:00100000:1.0:1788748439.862239:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388650752 00000100:00100000:1.0:1788748439.862271:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788748439.862277:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388650752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748439.862310:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875638388650752:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748439.862347:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:1.0:1788748439.862360:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788748439.862379:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84830700 x1875638388650752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748439.862391:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388650752:0@lo:400:kworker.0 00000100:00100000:0.0:1788748439.866334:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388650624:0@lo:400:kworker.0 00010000:00010000:3.0:1788748439.912208:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748440.107691:0:14250:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748440.107703:0:14250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748440.107734:0:14250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788748440.107741:0:14250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748440.257795:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.257906:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368651264 00000100:00100000:2.0:1788748440.257919:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368651264 00000100:00100000:2.0:1788748440.258022:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:2.0:1788748440.258034:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:11321:x1875638368651264:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748440.258068:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748440.258094:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a5ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c94 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.258240:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc600/0x9ba0f20a02e1a5f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.258258:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc600/0x9ba0f20a02e1a5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.258275:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc600/0x9ba0f20a02e1a5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748440.258290:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788748440.258469:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a5ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c94 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.258490:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc600/0x9ba0f20a02e1a5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c94 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.258499:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748440.258502:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748440.258506:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc600, rc 0) 00000100:00100000:2.0:1788748440.258583:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11321:x1875638368651264:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 552us (802us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788748440.258612:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00080000:3.0:1788748440.259475:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748440.261901:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748440.262365:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368651392 00000100:00100000:0.0:1788748440.262378:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368651392 00000100:00100000:0.0:1788748440.262449:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:0.0:1788748440.262461:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11321:x1875638368651392:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1788748440.262574:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262612:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262627:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262646:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262668:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262675:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262778:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262787:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262796:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748440.262862:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262880:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262888:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262896:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262903:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748440.262908:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262917:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262939:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748440.262942:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748440.262949:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262956:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a602 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262973:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262980:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262986:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.262992:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748440.262995:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263002:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263009:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1100) 00010000:00010000:0.0:1788748440.263011:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748440.263014:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263021:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263049:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263056:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263062:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263067:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748440.263071:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263077:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263084:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:0.0:1788748440.263087:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748440.263090:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.263096:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a610 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748440.263194:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11321:x1875638368651392:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 732us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748440.263203:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:2.0:1788748440.323836:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.323947:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368651648 00000100:00100000:1.0:1788748440.323962:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368651648 00000100:00100000:1.0:1788748440.327568:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:1.0:1788748440.327611:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11324:x1875638368651648:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748440.327659:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748440.327686:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3c9b expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.327778:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.327798:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.327811:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.327840:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.327848:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.327855:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328004:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328013:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328021:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748440.328033:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788748440.328144:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328153:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328161:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328168:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.328173:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328182:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328196:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748440.328199:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748440.328205:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328212:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a61e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328228:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328235:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328241:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328257:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69e00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.328261:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328269:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328278:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:1.0:1788748440.328281:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748440.328284:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328290:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a625 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328365:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 23 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328380:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 22 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.328387:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:1.0:1788748440.328390:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748440.328392:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68600, rc 0) 00000100:00100000:1.0:1788748440.328470:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:11324:x1875638368651648:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 886us (4656us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788748440.328479:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:3.0:1788748440.335311:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.335624:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368651776 00000100:00100000:2.0:1788748440.335637:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368651776 00000100:00100000:2.0:1788748440.335734:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1788748440.335746:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:11324:x1875638368651776:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1788748440.335911:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.335933:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.335948:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.335997:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.336006:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.336014:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.336020:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bde00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748440.336025:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.336033:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.336059:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:2.0:1788748440.336062:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748440.336068:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.336075:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a63a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748440.336172:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:11324:x1875638368651776:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 427us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748440.336180:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:1.0:1788748440.342209:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.343502:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368652032 00000100:00100000:2.0:1788748440.343673:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368652032 00000100:00100000:2.0:1788748440.343757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1788748440.343770:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7039c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:11324:x1875638368652032:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748440.344194:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7039c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:11324:x1875638368652032:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 424us (1998us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788748440.344204:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788748440.357513:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388650880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748440.357606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748440.359142:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388651008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748440.359212:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748440.359272:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388650880 00000100:00100000:1.0:1788748440.359282:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388650880 00000100:00100000:1.0:1788748440.359354:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388651008 00000100:00100000:1.0:1788748440.359358:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388651008 00000100:00100000:1.0:1788748440.359386:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788748440.359395:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388650880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748440.359434:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788748440.359481:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388650880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748440.359489:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788748440.359509:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788748440.359528:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388651008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748440.359538:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788748440.359566:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388651008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748440.359573:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788748440.359699:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748440.359746:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388651008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748440.359790:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388650880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748440.389467:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.390773:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368652288 00000100:00100000:2.0:1788748440.390788:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368652288 00000100:00100000:2.0:1788748440.390871:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1788748440.390883:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:10842:x1875638368652288:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748440.390917:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748440.390944:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a641 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ca2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.391092:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.391124:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 24 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.391135:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.391177:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 24 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.391194:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 24 pid: 10244 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748440.391210:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84831f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388651136:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748440.391350:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748440.400172:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84831f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388651136:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748440.400213:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748440.402407:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.402472:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368652416 00000100:00100000:2.0:1788748440.402485:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368652416 00010000:00010000:2.0:1788748440.402539:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 25 pid: 10244 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748440.402592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1788748440.402604:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:2411:x1875638368652416:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748440.402621:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748440.402628:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 25 pid: 10244 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.402643:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 25 pid: 10244 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.402681:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a62c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c9b expref: 25 pid: 10244 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.402696:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:2.0:1788748440.402702:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.402713:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.402720:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.402747:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748440.402812:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:2411:x1875638368652416:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 211us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748440.402821:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00010000:00010000:1.0:1788748440.403158:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.403168:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748440.403194:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788748440.403386:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1a641 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.403404:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.403412:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:1.0:1788748440.403415:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748440.403419:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bce00, rc 0) 00000100:00100000:1.0:1788748440.403463:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:10842:x1875638368652288:12345-192.168.203.22@tcp:101:bash.0 Request processed in 12583us (14011us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788748440.403473:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:1.0:1788748440.409894:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.410782:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368652544 00000100:00100000:2.0:1788748440.410799:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368652544 00000100:00100000:2.0:1788748440.410912:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:2.0:1788748440.410924:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:10842:x1875638368652544:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748440.410961:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748440.410987:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a656 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ca9 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.411032:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a65d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.411072:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a65d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.411086:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a65d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.411231:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a656 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca9 expref: 26 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.411252:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a65d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca9 expref: 25 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.411261:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:2.0:1788748440.411264:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748440.411285:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd200, rc 0) 00000100:00100000:2.0:1788748440.411389:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:10842:x1875638368652544:12345-192.168.203.22@tcp:101:bash.0 Request processed in 466us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748440.411396:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:1.0:1788748440.414645:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.415171:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368652800 00000100:00100000:2.0:1788748440.415183:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368652800 00000100:00100000:2.0:1788748440.415253:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:2.0:1788748440.415264:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:10842:x1875638368652800:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1788748440.415840:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.415864:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.415898:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748440.415954:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788748440.415983:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000007e836ce8 reply state 000000002e62d624 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.415998:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.416006:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:2.0:1788748440.416009:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748440.416014:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788748440.416098:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788748440.416230:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:10842:x1875638368652800:12345-192.168.203.22@tcp:36:bash.0 Request processed in 966us (1597us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788748440.416238:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000020:00080000:2.0:1788748440.416244:0:6510:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788748440.418998:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.419115:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368652928 00000100:00100000:1.0:1788748440.419128:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368652928 00000100:00100000:1.0:1788748440.419205:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:1.0:1788748440.419218:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:10842:x1875638368652928:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748440.419251:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748440.419794:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a66b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cb0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.419913:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a66b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb0 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.419932:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a66b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb0 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.419955:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:1.0:1788748440.419959:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748440.419964:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69000, rc 0) 00000100:00100000:1.0:1788748440.420059:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:10842:x1875638368652928:12345-192.168.203.22@tcp:101:bash.0 Request processed in 843us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748440.420068:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:1.0:1788748440.423079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748440.423176:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368653056 00000100:00100000:3.0:1788748440.423189:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368653056 00000100:00100000:3.0:1788748440.423295:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:3.0:1788748440.423309:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:10842:x1875638368653056:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788748440.423362:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748440.423388:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cb7 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748440.423421:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e2295, atime: 0x6a9e2293, ctime: 0x6a9e2295, blocks: 0x8 00010000:00010000:3.0:1788748440.423451:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788748440.423457:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748440.423467:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.423489:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.423505:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb000, rc 0) 00000100:00100000:3.0:1788748440.423592:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:10842:x1875638368653056:12345-192.168.203.22@tcp:101:bash.0 Request processed in 286us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748440.423599:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00080000:1.0:1788748440.423888:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748440.425709:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.425803:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368653184 00000100:00100000:1.0:1788748440.425814:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368653184 00002000:00010000:1.0:1788748440.425872:0:8430:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788748440.425877:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc843f2300 with x1875638368653184 ext(0->18446744073709551615) 00002000:00010000:1.0:1788748440.425890:0:8430:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc843f2300. 00000100:00100000:1.0:1788748440.425927:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1788748440.425937:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368653184:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:1.0:1788748440.426456:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788748440.426462:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788748437 -> 1788748441 00002000:00010000:1.0:1788748440.426464:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788748435 -> 1788748435 00002000:00010000:1.0:1788748440.426467:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788748437 -> 1788748441 00002000:00010000:1.0:1788748440.426481:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788748440.426561:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2412:x1875638368653184:12345-192.168.203.22@tcp:10:bash.0 Request processed in 625us (862us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788748440.426571:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00010000:1.0:1788748440.426576:0:8430:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788748440.426580:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc843f2300 with x1875638368653184 ext(0->18446744073709551615) 00002000:00010000:1.0:1788748440.426585:0:8430:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc843f2300. 00000100:00100000:2.0:1788748440.482606:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.482689:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368653312 00000100:00100000:1.0:1788748440.482702:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368653312 00000100:00100000:1.0:1788748440.482782:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:1.0:1788748440.482794:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:11338:x1875638368653312:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1788748440.482904:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.482927:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.482942:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.482961:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.482968:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.482975:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483078:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483104:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483110:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748440.483165:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483178:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483185:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483192:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483199:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68c00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.483203:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483212:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483225:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748440.483228:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748440.483234:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483240:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a679 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483276:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483283:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483289:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483294:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69e00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.483298:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483304:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483313:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:1.0:1788748440.483377:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748440.483381:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483387:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a680 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483404:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483410:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483415:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483427:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.483430:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483437:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483447:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:1.0:1788748440.483449:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748440.483452:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.483459:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748440.483561:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:11338:x1875638368653312:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 768us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748440.483571:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:2.0:1788748440.537225:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748440.537355:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368653568 00000100:00100000:0.0:1788748440.537369:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368653568 00000100:00100000:0.0:1788748440.537452:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:0.0:1788748440.537500:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:11341:x1875638368653568:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748440.537539:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748440.537568:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a68e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cbe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537674:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537693:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537708:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537724:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537731:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537738:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537895:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a6a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537906:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.537913:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748440.537938:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788748440.538051:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538060:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538068:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538076:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748440.538081:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538091:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538107:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748440.538111:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748440.538119:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538127:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a695 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538148:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538154:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538171:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538176:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748440.538179:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538185:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538193:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1400) 00010000:00010000:0.0:1788748440.538196:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748440.538199:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538205:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a69c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538256:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a68e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cbe expref: 33 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538273:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cbe expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.538281:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:0.0:1788748440.538283:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788748440.538286:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a800, rc 0) 00000100:00100000:1.0:1788748440.539390:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11341:x1875638368653568:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1888us (2172us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788748440.539403:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:3.0:1788748440.545525:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.545761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368653696 00000100:00100000:1.0:1788748440.545775:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368653696 00000100:00100000:1.0:1788748440.545867:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:1.0:1788748440.545881:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11341:x1875638368653696:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1788748440.545978:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.546024:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.546036:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.546082:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.546101:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 32 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748440.546120:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388651264:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748440.546250:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc841453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748440.548984:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388651264:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748440.549020:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748440.549935:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.550036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368653952 00000100:00100000:2.0:1788748440.550047:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368653952 00000100:00100000:2.0:1788748440.550123:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1788748440.550134:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:6181:x1875638368653952:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788748440.550941:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:6181:x1875638368653952:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 803us (1007us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788748440.550952:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1788748440.555392:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748440.555623:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368654080 00000100:00100000:3.0:1788748440.555636:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368654080 00010000:00010000:3.0:1788748440.555688:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 34 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748440.555782:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:3.0:1788748440.555795:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:2410:x1875638368654080:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748440.555813:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748440.555833:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 34 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.555850:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 34 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.555876:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a648 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca2 expref: 34 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.555894:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:3.0:1788748440.555900:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.555911:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.555919:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.555987:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748440.556054:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:2410:x1875638368654080:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 261us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748440.556062:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00010000:00010000:1.0:1788748440.556447:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556457:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556509:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556529:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556536:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556543:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.556549:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556558:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556570:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:1.0:1788748440.556573:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748440.556577:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.556583:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748440.556640:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11341:x1875638368653696:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 10761us (11138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748440.556649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:2.0:1788748440.559857:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.560019:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368654336 00000100:00100000:1.0:1788748440.560098:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368654336 00000100:00100000:1.0:1788748440.560209:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1788748440.560222:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:11341:x1875638368654336:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748440.560583:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:11341:x1875638368654336:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 363us (740us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788748440.560613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1788748440.655528:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748440.655828:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368654592 00000100:00100000:0.0:1788748440.655838:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368654592 00000100:00100000:0.0:1788748440.655915:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:0.0:1788748440.655925:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:11352:x1875638368654592:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1788748440.655951:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748440.655971:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a6b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cc5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656040:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656055:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656529:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656548:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656556:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656723:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656854:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a6cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656865:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656872:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748440.656897:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788748440.656978:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656986:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656993:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.656999:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748440.657003:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657011:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657023:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748440.657026:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748440.657031:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657038:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a6bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657053:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657059:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657253:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657259:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748440.657262:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657269:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657277:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8adda17e1400) 00010000:00010000:0.0:1788748440.657280:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748440.657398:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657405:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a6c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657455:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a6b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cc5 expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657471:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a6cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cc5 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.657479:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:0.0:1788748440.657482:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748440.657485:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748440.657861:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:11352:x1875638368654592:12345-192.168.203.22@tcp:101:cat.0 Request processed in 1935us (2355us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788748440.657881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:3.0:1788748440.663442:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.664750:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368654848 00000100:00100000:2.0:1788748440.664763:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368654848 00000100:00100000:2.0:1788748440.664854:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1788748440.664866:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:11352:x1875638368654848:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:2.0:1788748440.665376:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:11352:x1875638368654848:12345-192.168.203.22@tcp:35:cat.0 Request processed in 510us (1942us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788748440.665384:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788748440.691499:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.691995:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368655104 00000100:00100000:1.0:1788748440.692008:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368655104 00000100:00100000:1.0:1788748440.692177:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:1.0:1788748440.692189:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:11353:x1875638368655104:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:1.0:1788748440.692304:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788748440.692377:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a66b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb0 expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692403:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a6cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cc5 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692418:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a6a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cbe expref: 34 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692431:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a65d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ca9 expref: 33 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692441:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:1.0:1788748440.692446:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748440.692471:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692485:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692495:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692529:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692537:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692544:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692643:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692652:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.692659:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748440.693222:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788748440.693235:0:6510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357679917720ns, next at 358679914112ns, rc = 0 00010000:00010000:1.0:1788748440.693309:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693375:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693385:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693394:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693417:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693424:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693457:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748440.693483:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693491:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693498:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693505:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.693512:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693521:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693536:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:0.0:1788748440.693538:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748440.693540:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788748440.693548:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.693556:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693558:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.693579:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748440.693581:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.693585:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693624:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.693627:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693653:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693661:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.693672:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.693673:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:0.0:1788748440.693683:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788748440.693690:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693693:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.693718:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a6f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693724:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748440.693729:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748440.693735:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693741:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.693745:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748440.693752:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748440.693754:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1788748440.693758:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004969bbd3 reply state 0000000000eed822 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693772:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.693779:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:1.0:1788748440.693781:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748440.693785:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748440.693918:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:11353:x1875638368655104:12345-192.168.203.22@tcp:36:rm.0 Request processed in 1727us (2428us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788748440.693935:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:0.0:1788748440.763283:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.763487:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368655360 00000100:00100000:1.0:1788748440.763521:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368655360 00000100:00100000:1.0:1788748440.763613:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:1.0:1788748440.763626:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:11359:x1875638368655360:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748440.763662:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748440.763691:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6f7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ccc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.763851:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.763870:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.763886:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.763899:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.763906:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.763913:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748440.764529:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788748440.764723:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764745:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764756:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764798:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764806:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764813:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764834:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748440.764840:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764849:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764863:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748440.764867:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748440.764874:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764882:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a6fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748440.764897:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c2208c37 reply state 00000000cb4ada28 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764917:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764923:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:1.0:1788748440.764925:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748440.764928:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788748440.764966:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a6f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764983:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.764991:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:1.0:1788748440.764993:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748440.764995:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69800, rc 0) 00000100:00100000:1.0:1788748440.765089:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:11359:x1875638368655360:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1466us (1818us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788748440.765097:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:0.0:1788748440.770379:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.770508:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368655488 00000100:00100000:1.0:1788748440.770528:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368655488 00000100:00100000:1.0:1788748440.770617:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1788748440.770630:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368655488:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748440.770657:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748440.770685:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cd3 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748440.770718:0:8734:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788748440.770765:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1788748440.770771:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748440.770783:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 8 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.770808:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 8 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.770836:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68000, rc 0) 00000100:00100000:1.0:1788748440.770909:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368655488:12345-192.168.203.22@tcp:101:bash.0 Request processed in 282us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748440.770917:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00080000:3.0:1788748440.771686:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748440.774311:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748440.776027:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368655616 00000100:00100000:0.0:1788748440.776111:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368655616 00000100:00100000:0.0:1788748440.776235:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788748440.776249:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:11359:x1875638368655616:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748440.776274:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748440.776350:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cda expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.776397:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 9 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.776408:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748440.776413:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748440.776420:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.776467:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 9 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.776485:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 9 pid: 8734 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748440.776527:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875638388651392:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748440.776662:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748440.783275:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748440.783564:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368655744 00000100:00100000:2.0:1788748440.783578:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368655744 00010000:00010000:2.0:1788748440.783712:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 10 pid: 8734 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748440.783766:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1788748440.783778:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:2410:x1875638368655744:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748440.783797:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748440.783835:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 10 pid: 8734 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.783853:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 10 pid: 8734 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.783885:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748440.783891:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748440.783901:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.783933:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.783978:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 10 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748440.783995:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1875638388651520:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788748440.784204:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add853729c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788748440.784907:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064577ff3/0x9ba0f20a02e1a71a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cd3 expref: 10 pid: 8734 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748440.784933:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875638388651392:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748440.784967:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.784981:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148bc00, rc 0) 00000100:00100000:3.0:1788748440.785044:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:11359:x1875638368655616:12345-192.168.203.22@tcp:101:bash.0 Request processed in 8787us (10735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748440.785053:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:1.0:1788748440.788537:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748440.788760:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368656000 00000100:00100000:0.0:1788748440.788773:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368656000 00000100:00100000:0.0:1788748440.788861:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788748440.788873:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:11359:x1875638368656000:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1788748440.789255:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:11359:x1875638368656000:12345-192.168.203.22@tcp:35:bash.0 Request processed in 384us (728us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788748440.789289:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1788748440.790913:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1875638388651520:192.168.203.22@tcp:105: 00010000:00010000:2.0:1788748440.790948:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748440.791009:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368655744:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 7233us (7747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748440.791020:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000001:00080000:1.0:1788748440.877658:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1788748440.877703:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788748440.932545:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748440.949725:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748440.949919:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368656128 00000100:00100000:0.0:1788748440.949933:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368656128 00000100:00100000:0.0:1788748440.950447:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:0.0:1788748440.950462:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:11375:x1875638368656128:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748440.950497:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748440.950877:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ce1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.950970:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a72f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.950988:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.951012:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748440.951081:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788748440.951085:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748440.951118:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a72f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.951148:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ce1 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.951171:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a72f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ce1 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.951214:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748440.951217:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748440.951220:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a600, rc 0) 00000100:00100000:0.0:1788748440.951312:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:11375:x1875638368656128:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 854us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748440.951893:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:0.0:1788748440.964568:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.964718:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368656384 00000100:00100000:1.0:1788748440.964731:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368656384 00000100:00100000:1.0:1788748440.964818:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:1.0:1788748440.964838:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:11375:x1875638368656384:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748440.964865:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748440.964889:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a736 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ce8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.965257:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a73d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.965275:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a73d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.965309:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a73d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748440.965747:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788748440.965911:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a736 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ce8 expref: 42 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.965937:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a73d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ce8 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748440.965945:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:1.0:1788748440.965948:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748440.965952:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69a00, rc 0) 00000100:00100000:1.0:1788748440.966608:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+41:11375:x1875638368656384:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1767us (2048us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1788748440.966618:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:1.0:1788748440.980697:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.980746:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748440.980902:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368656640 00000100:00100000:0.0:1788748440.980915:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368656640 00000100:00100000:0.0:1788748440.981012:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788748440.981024:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+41:2411:x1875638368656640:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748440.981044:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748440.981075:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a73d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ce8 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748440.981097:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:0.0:1788748440.981103:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748440.981189:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+40:2411:x1875638368656640:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 158us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748440.981197:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1788748440.984930:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368656768 00000100:00100000:2.0:1788748440.984951:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368656768 00000100:00100000:2.0:1788748440.986018:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:2.0:1788748440.986039:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+40:11375:x1875638368656768:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748440.986075:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748440.986104:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a74b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cef expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.986259:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a752 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.986299:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a752 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.986314:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a752 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748440.986357:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788748440.986492:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a74b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cef expref: 43 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.986513:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a752 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cef expref: 42 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748440.986523:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:2.0:1788748440.986526:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788748440.986530:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd600, rc 0) 00000100:00100000:2.0:1788748440.986616:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:11375:x1875638368656768:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 585us (5868us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788748440.986623:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:1.0:1788748440.993043:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748440.993574:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368656896 00000100:00100000:3.0:1788748440.993588:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368656896 00000100:00100000:3.0:1788748440.993706:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1788748440.993719:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368656896:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:3.0:1788748440.993778:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.993839:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.993851:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748440.993856:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748440.993862:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.993910:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748440.993928:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 6 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748440.993945:0:8734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8734:1875638388651648:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748440.994452:0:8734:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748440.999863:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748440.999976:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368657024 00000100:00100000:1.0:1788748440.999988:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368657024 00002000:00100000:1.0:1788748441.000070:0:8432:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8adc83f80a80 x1875638368657024/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:186/0 lens 504/0 e 0 to 0 dl 1788748451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748441.000083:0:8432:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc83f80a80 with x1875638368657024 ext(0->8) 00010000:00010000:1.0:1788748441.000094:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 7 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.000140:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 7 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748441.000150:0:8432:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc83f80a80 00000100:00100000:1.0:1788748441.000205:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1788748441.000218:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368657024:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:1.0:1788748441.001512:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2410:x1875638368657024:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 1287us (1654us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788748441.001527:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00100000:1.0:1788748441.001538:0:8432:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8adc83f80a80 x1875638368657024/t4294967303(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:186/0 lens 504/448 e 0 to 0 dl 1788748451 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748441.001551:0:8432:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc83f80a80 with x1875638368657024 ext(0->8) 00010000:00010000:1.0:1788748441.001561:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.001582:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788748441.001590:0:8432:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc83f80a80 00000100:00100000:3.0:1788748441.002358:0:8734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8734:1875638388651648:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748441.002391:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.005369:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.005512:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368657152 00000100:00100000:1.0:1788748441.005536:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368657152 00010000:00010000:1.0:1788748441.005589:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.005798:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1788748441.005811:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2412:x1875638368657152:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748441.005842:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788748441.005866:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788748441.005869:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788748441 00002000:00010000:1.0:1788748441.005871:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788748441 00002000:00010000:1.0:1788748441.005873:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788748441 00002000:00010000:1.0:1788748441.005875:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788748441.005883:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.005901:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.005929:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1a721 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cda expref: 9 pid: 8427 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.005951:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748441.005957:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748441.005963:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.005973:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.006027:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748441.006102:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2412:x1875638368657152:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 292us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.006113:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00010000:00010000:3.0:1788748441.006837:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006871:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006903:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006913:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006921:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006930:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbac00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748441.006934:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006944:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006961:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.006968:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a760 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.007064:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368656896:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 13345us (14032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.007075:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1788748441.010017:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.010120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368657408 00000100:00100000:0.0:1788748441.010135:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368657408 00000100:00100000:0.0:1788748441.010306:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1788748441.010363:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda703b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:11375:x1875638368657408:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:0.0:1788748441.010484:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a752 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cef expref: 42 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748441.010732:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788748441.010765:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788748441.011172:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788748441.011226:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.011244:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.011253:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.011296:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 46 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.011342:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 46 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.011360:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388651776:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748441.011474:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748441.015013:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388651776:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748441.015060:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.018359:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.018847:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368657536 00000100:00100000:0.0:1788748441.018883:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368657536 00010000:00010000:0.0:1788748441.018944:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 47 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.018993:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1788748441.019006:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+47:2411:x1875638368657536:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748441.019028:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748441.019036:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 47 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.019060:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 47 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.019092:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a70c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ccc expref: 47 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.019112:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:0.0:1788748441.019118:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.019128:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.019137:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.019237:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748441.019360:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+46:2411:x1875638368657536:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 355us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.019379:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00010000:00010000:1.0:1788748441.019489:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.019499:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748441.019897:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788748441.020078:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788748441.020897:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388651904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748441.020966:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748441.021009:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5111e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748441.021029:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388651904 00000100:00100000:3.0:1788748441.021082:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388651904 00000100:00080000:1.0:1788748441.021135:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748441.021206:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788748441.021218:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388651904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788748441.021447:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388651904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 231us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.021455:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788748441.021556:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1788748441.021562:0:6514:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1788748441.021590:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8addbc908700, transno 4294967302 00000100:00100000:0.0:1788748441.021668:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388651904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748441.021844:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788748441.021925:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388652032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748441.021955:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748441.021983:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748441.022008:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388652032 00000100:00100000:3.0:1788748441.022014:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388652032 00000100:00100000:3.0:1788748441.022134:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788748441.022144:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388652032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788748441.022352:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1875638388652032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 208us (394us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788748441.022360:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788748441.022469:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83f81f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388652032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788748441.022534:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788748441.022578:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.022592:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.022766:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.022773:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.022779:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.022787:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.022837:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:1.0:1788748441.022840:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788748441.022846:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.022853:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a767 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748441.022963:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788748441.023028:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788748441.023119:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358009801785ns, next at 359009798638ns, rc = 0 00000001:00080000:1.0:1788748441.023128:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788748441.023160:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:1.0:1788748441.023163:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788748441.023171:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a752 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cef expref: 50 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.023290:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda703b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:11375:x1875638368657408:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 12973us (13285us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788748441.023299:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000020:00080000:1.0:1788748441.023303:0:6514:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788748441.025309:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.025583:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368657664 00000100:00100000:0.0:1788748441.025651:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368657664 00000100:00100000:0.0:1788748441.025722:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:0.0:1788748441.025733:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:11375:x1875638368657664:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748441.025764:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748441.025794:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a76e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cf6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.025879:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a76e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cf6 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.025896:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a76e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cf6 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.025941:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748441.025945:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748441.025949:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148bc00, rc 0) 00000100:00100000:0.0:1788748441.026015:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+50:11375:x1875638368657664:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 283us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.026022:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:2.0:1788748441.028707:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.028794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368657920 00000100:00100000:1.0:1788748441.028806:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368657920 00000100:00100000:1.0:1788748441.028889:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1788748441.028901:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+50:11375:x1875638368657920:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748441.029218:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+51:11375:x1875638368657920:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 318us (521us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788748441.029244:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:2.0:1788748441.106118:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.106224:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368658048 00000100:00100000:1.0:1788748441.106237:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368658048 00000100:00100000:1.0:1788748441.106359:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:1.0:1788748441.106372:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+51:11385:x1875638368658048:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1788748441.106472:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106495:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106509:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106520:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106528:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106535:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106644:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106653:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106660:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748441.106754:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106770:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106778:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106787:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106793:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.106798:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106806:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106833:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748441.106836:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.106842:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106849:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a775 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106865:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106871:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106884:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106890:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.106893:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106900:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106908:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:1.0:1788748441.106911:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.106914:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106920:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a77c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106930:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106935:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106942:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106947:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.106950:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106966:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106974:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.106976:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.106980:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.106986:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a783 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.107086:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+51:11385:x1875638368658048:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 715us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.107094:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:3.0:1788748441.153774:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.153977:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368658304 00000100:00100000:2.0:1788748441.153991:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368658304 00000100:00100000:2.0:1788748441.154081:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:2.0:1788748441.154094:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+51:11388:x1875638368658304:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748441.154122:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748441.154151:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a78a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3cfd expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154287:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154306:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154360:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154374:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154382:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154389:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154533:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154542:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154550:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748441.154561:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788748441.154674:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154682:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154697:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154704:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748441.154709:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154717:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154732:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748441.154736:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748441.154742:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154749:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a791 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154764:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154770:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154776:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154782:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bca00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748441.154785:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154803:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154812:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:2.0:1788748441.154814:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748441.154827:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154833:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a798 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154883:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a78a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 54 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154901:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 53 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.154909:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.154912:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748441.154914:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd200, rc 0) 00000100:00100000:2.0:1788748441.155009:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:11388:x1875638368658304:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 917us (1249us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788748441.155018:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:2.0:1788748441.158809:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.158917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368658432 00000100:00100000:0.0:1788748441.158932:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368658432 00000100:00100000:0.0:1788748441.159009:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:0.0:1788748441.159022:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:11388:x1875638368658432:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788748441.159119:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159140:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159154:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159199:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159207:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159214:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159220:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748441.159244:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159262:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159284:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748441.159288:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748441.159294:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.159300:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.159424:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:11388:x1875638368658432:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 404us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.159432:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:0.0:1788748441.165197:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.165557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368658688 00000100:00100000:2.0:1788748441.165571:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368658688 00000100:00100000:2.0:1788748441.165656:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:2.0:1788748441.165669:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:11388:x1875638368658688:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748441.166025:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11388:x1875638368658688:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 357us (841us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788748441.166044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:3.0:1788748441.265279:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.265654:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368658944 00000100:00100000:1.0:1788748441.265668:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368658944 00000100:00100000:2.0:1788748441.265863:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:2.0:1788748441.265881:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11398:x1875638368658944:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748441.265918:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748441.265922:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788748441.265969:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a72f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ce1 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.265999:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748441.266005:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748441.266022:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a7b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d04 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.268834:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.268860:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 54 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.268868:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.268931:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 54 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.268952:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 54 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.269000:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84831880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388652160:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748441.269480:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748441.273429:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84831880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388652160:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748441.273476:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.280205:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.281885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368659072 00000100:00100000:2.0:1788748441.281962:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368659072 00010000:00010000:2.0:1788748441.282034:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 55 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.282246:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1788748441.282260:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+55:2412:x1875638368659072:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748441.282282:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.282291:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 55 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.282309:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 55 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.282361:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a79f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cfd expref: 55 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.282383:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.282389:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.282418:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.282427:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.282472:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748441.282568:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:2412:x1875638368659072:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 312us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.282577:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00010000:00010000:0.0:1788748441.282645:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.282655:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748441.282680:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788748441.282879:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1a7b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 55 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.282898:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 54 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.282930:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748441.282933:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748441.282936:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bca00, rc 0) 00000100:00100000:0.0:1788748441.282970:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11398:x1875638368658944:12345-192.168.203.22@tcp:101:bash.0 Request processed in 17095us (17704us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788748441.282977:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:3.0:1788748441.287780:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.287916:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368659200 00000100:00100000:1.0:1788748441.287929:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368659200 00000100:00100000:1.0:1788748441.288000:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:1.0:1788748441.288014:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:11398:x1875638368659200:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748441.288049:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748441.288077:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a7c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d0b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.288128:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.288144:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.288181:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.288373:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a7c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.288394:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.288403:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.288406:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748441.288411:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68200, rc 0) 00000100:00100000:1.0:1788748441.288482:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+55:11398:x1875638368659200:12345-192.168.203.22@tcp:101:bash.0 Request processed in 471us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.288490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:3.0:1788748441.293407:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.294165:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368659456 00000100:00100000:1.0:1788748441.294180:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368659456 00000100:00100000:1.0:1788748441.294280:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:1.0:1788748441.294294:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+55:11398:x1875638368659456:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1788748441.294646:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.294669:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.294683:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748441.294769:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1788748441.294798:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ba41e51b reply state 00000000b2886c6b transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.294813:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.294841:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.294844:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748441.294849:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748441.294964:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:11398:x1875638368659456:12345-192.168.203.22@tcp:36:bash.0 Request processed in 672us (1571us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788748441.294972:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000020:00080000:1.0:1788748441.294978:0:6510:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788748441.307960:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.308436:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368659584 00000100:00100000:0.0:1788748441.308449:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368659584 00000100:00100000:0.0:1788748441.308534:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1788748441.308547:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:11398:x1875638368659584:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748441.308581:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748441.308607:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d12 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.308726:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.308743:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 59 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.308753:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.308795:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 59 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.308812:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 59 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.308858:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3a88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388652288:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748441.308974:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748441.316251:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3a88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388652288:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748441.316290:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.318107:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.319796:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368659712 00000100:00100000:2.0:1788748441.319814:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368659712 00010000:00010000:2.0:1788748441.320159:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 60 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.320273:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:2.0:1788748441.320286:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:2411:x1875638368659712:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748441.320309:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.320346:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 60 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.320364:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 60 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.320392:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a7bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d04 expref: 60 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.320437:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.320444:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.320457:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.320467:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.320503:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748441.320611:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:2411:x1875638368659712:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 328us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.320619:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00010000:00010000:1.0:1788748441.320693:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.320703:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748441.320773:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788748441.320779:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748441.320806:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.320859:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 59 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.320878:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 58 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.320901:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.320904:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748441.320906:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a400, rc 0) 00000100:00100000:1.0:1788748441.320938:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:11398:x1875638368659584:12345-192.168.203.22@tcp:101:bash.0 Request processed in 12395us (12995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.320946:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:2.0:1788748441.325769:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.326052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368659968 00000100:00100000:0.0:1788748441.326066:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368659968 00000100:00100000:0.0:1788748441.326168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1788748441.326181:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:11398:x1875638368659968:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1788748441.326515:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:11398:x1875638368659968:12345-192.168.203.22@tcp:35:bash.0 Request processed in 335us (758us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788748441.326524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1788748441.397575:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.397630:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.397715:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.397813:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660608 00000100:00100000:2.0:1788748441.397840:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660608 00000100:00100000:2.0:1788748441.397930:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 276 00000100:00100000:2.0:1788748441.397943:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368660608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748441.398021:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660096 00000100:00100000:0.0:1788748441.398027:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660096 00000100:00100000:0.0:1788748441.398062:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 380 00000100:00100000:0.0:1788748441.398071:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368660096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748441.398147:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660352 00000100:00100000:1.0:1788748441.398152:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660352 00000100:00100000:2.0:1788748441.398171:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368660608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 231us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.398180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 276 00000100:00100000:1.0:1788748441.398183:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:1.0:1788748441.398189:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368660352:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748441.398559:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368660096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 488us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.398567:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 380 00000100:00080000:3.0:1788748441.398703:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748441.399091:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368660352:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 899us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.399100:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:0.0:1788748441.399161:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.399221:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.399351:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660224 00000100:00100000:3.0:1788748441.399358:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660224 00000100:00100000:3.0:1788748441.399406:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660480 00000100:00100000:3.0:1788748441.399410:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660480 00000100:00100000:3.0:1788748441.399434:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:3.0:1788748441.399442:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368660224:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748441.399491:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368660224:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 50us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.399498:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:3.0:1788748441.399524:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 278 00000100:00100000:3.0:1788748441.399531:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368660480:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748441.399559:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368660480:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.399565:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 278 00000100:00080000:3.0:1788748441.399582:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748441.399585:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748441.415996:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.416187:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660736 00000100:00100000:0.0:1788748441.416200:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660736 00000100:00100000:0.0:1788748441.416274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:0.0:1788748441.416296:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:11404:x1875638368660736:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748441.416371:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748441.416400:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d19 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.416487:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a7f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.416506:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.416742:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748441.416802:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788748441.416806:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748441.416841:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.416872:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a7ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d19 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.416896:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d19 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.416905:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:0.0:1788748441.416927:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748441.416932:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a600, rc 0) 00000100:00100000:0.0:1788748441.417009:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:11404:x1875638368660736:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 717us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.417018:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:2.0:1788748441.422485:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.422607:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660864 00000100:00100000:1.0:1788748441.422621:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660864 00000100:00100000:1.0:1788748441.422714:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:1.0:1788748441.422727:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:11404:x1875638368660864:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748441.422754:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748441.422781:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a7fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d20 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.422877:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.422897:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.422911:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.422948:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.422956:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.422963:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423182:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423193:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423201:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748441.423256:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788748441.423262:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748441.423285:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423299:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423309:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423440:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423460:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423467:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.423472:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423481:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423496:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748441.423500:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.423506:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423588:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a801 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423605:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423612:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423618:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423623:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.423626:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423644:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423652:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:1.0:1788748441.423655:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.423660:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423665:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1a808 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423850:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a7fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 62 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423868:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 61 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.423876:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.423879:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748441.423882:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68000, rc 0) 00000100:00100000:1.0:1788748441.424023:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11404:x1875638368660864:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1299us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.424042:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:1.0:1788748441.429245:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.429385:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.429464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368661248 00000100:00100000:0.0:1788748441.429477:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368661248 00000100:00100000:0.0:1788748441.429557:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:0.0:1788748441.429570:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11404:x1875638368661248:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748441.429599:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748441.429626:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a816 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d27 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.429770:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.429789:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 62 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.429798:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 62 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.429806:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.429890:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 62 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.429907:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.429933:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84942680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388652416:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748441.430072:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 62 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.430082:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.430091:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84942d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388652544:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748441.430118:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaafc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748441.430358:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368660992 00000100:00100000:2.0:1788748441.430365:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368660992 00010000:00010000:2.0:1788748441.430399:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 63 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.430451:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1788748441.430460:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:2413:x1875638368660992:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748441.430473:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.430480:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 63 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.430491:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 63 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.430525:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.430530:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.430538:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.430545:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748441.430577:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:2413:x1875638368660992:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 118us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.430586:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00010000:00010000:1.0:1788748441.434936:0:6510:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.22@tcp) returned -22 from blocking AST (req@00000000561b0e8a x1875638388652416) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.434994:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1a80f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d20 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.435016:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84942680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388652416:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748441.435034:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84942d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388652544:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748441.435060:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.435067:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.435078:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.435089:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.436429:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.436526:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368661376 00000100:00100000:0.0:1788748441.436538:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368661376 00010000:00010000:0.0:1788748441.436591:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.436639:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:0.0:1788748441.436651:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:2410:x1875638368661376:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748441.436668:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748441.436674:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.436690:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.436731:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1a7e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d12 expref: 62 pid: 8447 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.436770:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748441.436775:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.436786:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.436794:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.436833:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748441.436908:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:2410:x1875638368661376:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 259us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.436915:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00010000:00010000:1.0:1788748441.437064:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.437073:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748441.437098:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788748441.437265:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a816 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.437287:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.437304:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.437306:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748441.437309:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a800, rc 0) 00000100:00100000:1.0:1788748441.437380:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11404:x1875638368661248:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 7813us (7995us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788748441.437387:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:3.0:1788748441.441706:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.441893:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368661632 00000100:00100000:2.0:1788748441.441907:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368661632 00000100:00100000:2.0:1788748441.441987:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1788748441.442000:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11404:x1875638368661632:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:2.0:1788748441.442022:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.442066:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a76e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cf6 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.442111:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.442117:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748441.442188:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:11404:x1875638368661632:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 190us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.442196:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788748441.445496:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.445894:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368661760 00000100:00100000:1.0:1788748441.445908:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368661760 00000100:00100000:1.0:1788748441.446024:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:1.0:1788748441.446243:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:11404:x1875638368661760:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:1.0:1788748441.446596:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.446618:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.446632:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748441.446757:0:10244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788748441.446940:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:11404:x1875638368661760:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 701us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.446949:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1788748441.449873:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.450834:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368661888 00000100:00100000:2.0:1788748441.450850:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368661888 00000100:00100000:2.0:1788748441.450977:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:2.0:1788748441.450990:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:11404:x1875638368661888:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748441.451017:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748441.451057:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d2e expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.451131:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.451145:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 61 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.451169:0:8447:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.451187:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 61 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.451203:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.451224:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748441.451229:0:8447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 61 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.451237:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bce00, rc 0) 00000100:00100000:2.0:1788748441.451461:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11404:x1875638368661888:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 473us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.451468:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000040:00080000:1.0:1788748441.508632:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748441.508646:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748441.508678:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788748441.508719:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748441.508940:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388652672:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788748441.509099:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748441.514697:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.514906:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388652672:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748441.514958:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368662016 00000100:00100000:2.0:1788748441.514978:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368662016 00000100:00100000:2.0:1788748441.515050:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:2.0:1788748441.515062:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11405:x1875638368662016:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748441.515105:0:6510:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748441.515410:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11405:x1875638368662016:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 348us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.515419:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:3.0:1788748441.518826:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.519489:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368662144 00000100:00100000:1.0:1788748441.519504:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368662144 00000100:00100000:1.0:1788748441.519591:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:1.0:1788748441.519603:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11405:x1875638368662144:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788748441.519697:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519719:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519732:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519752:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519761:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519767:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519798:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519808:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519843:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748441.519903:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788748441.519909:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748441.519925:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519939:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519946:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519955:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519962:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69c00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.519967:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519976:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.519989:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:1.0:1788748441.519992:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.519998:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520006:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a839 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520649:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520660:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520665:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520670:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69e00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.520673:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520679:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520688:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8add91e32f00) 00010000:00010000:1.0:1788748441.520690:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.520693:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520699:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1a840 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520716:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520722:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520727:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520742:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.520745:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520751:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520760:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.520763:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.520766:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.520771:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.520896:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11405:x1875638368662144:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 1292us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.520905:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:1.0:1788748441.530375:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.530871:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368662400 00000100:00100000:2.0:1788748441.530884:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368662400 00000100:00100000:2.0:1788748441.530980:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:2.0:1788748441.530992:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:11405:x1875638368662400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748441.531021:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748441.531055:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a84e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d35 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531200:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531218:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531272:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748441.531288:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788748441.531809:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531839:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531847:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531854:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748441.531859:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531867:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531883:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.531887:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748441.531893:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.531899:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.532680:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a84e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d35 expref: 63 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.532721:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:2.0:1788748441.532723:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748441.532729:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a84e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d35 expref: 63 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.532742:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc200, rc 0) 00000100:00100000:2.0:1788748441.532902:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:11405:x1875638368662400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1911us (2539us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788748441.532913:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:0.0:1788748441.541083:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.541304:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368662528 00000100:00100000:3.0:1788748441.541452:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368662528 00000100:00100000:3.0:1788748441.541745:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:3.0:1788748441.541759:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:11405:x1875638368662528:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788748441.541811:0:6512:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788748441.543237:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:11405:x1875638368662528:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 1470us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.543604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:3.0:1788748441.558548:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.558648:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368662784 00000100:00100000:1.0:1788748441.558661:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368662784 00000100:00100000:1.0:1788748441.558739:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:1.0:1788748441.558750:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:11405:x1875638368662784:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748441.558777:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748441.558781:0:10244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788748441.558825:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a7f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d19 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.558875:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:1.0:1788748441.558881:0:10244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748441.558896:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a863 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d3c expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748441.561634:0:10244:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788748441.561920:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a86a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.561943:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.564110:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a86a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.564288:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a863 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d3c expref: 64 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.564361:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a86a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d3c expref: 63 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.564372:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8adda17e1f00) 00010000:00010000:0.0:1788748441.564375:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748441.564379:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:0.0:1788748441.564476:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:11405:x1875638368662784:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 5726us (5940us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788748441.564486:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:0.0:1788748441.568145:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.568255:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368663040 00000100:00100000:2.0:1788748441.568268:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368663040 00000100:00100000:2.0:1788748441.568497:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:2.0:1788748441.568521:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:11405:x1875638368663040:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748441.568866:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.568904:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a86a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d3c expref: 63 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.568928:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8adda17e1f00) 00010000:00010000:2.0:1788748441.568942:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748441.568972:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.568988:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.568999:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569110:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569120:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569129:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569185:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569193:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569199:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569206:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748441.569210:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569219:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569227:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748441.569230:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748441.569236:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569243:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1a878 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569262:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569270:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569276:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569281:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748441.569284:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569290:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569297:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9b0f4611 (ffff8adc8259cf00) 00010000:00010000:2.0:1788748441.569300:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748441.569303:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.569309:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a87f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9b0f4611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.569593:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:11405:x1875638368663040:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1084us (1460us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748441.569602:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:1.0:1788748441.575907:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.576005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368663168 00000100:00100000:3.0:1788748441.576019:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368663168 00000100:00100000:3.0:1788748441.576104:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:3.0:1788748441.576117:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:11405:x1875638368663168:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748441.576146:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748441.576175:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a886 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d43 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.576225:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.576242:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.576256:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.576449:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.576487:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.576497:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:3.0:1788748441.576500:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788748441.576504:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbbe00, rc 0) 00000100:00100000:3.0:1788748441.576860:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:11405:x1875638368663168:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 743us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.576869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:1.0:1788748441.585113:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.585258:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368663424 00000100:00100000:0.0:1788748441.585271:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368663424 00000100:00100000:0.0:1788748441.585544:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:0.0:1788748441.585559:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:11405:x1875638368663424:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748441.585712:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.585733:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.585749:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748441.585978:0:10244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1788748441.586218:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a4a26539 reply state 00000000ed2e1db1 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.586247:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.586256:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:0.0:1788748441.586259:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788748441.586264:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748441.586840:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:11405:x1875638368663424:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1280us (1737us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788748441.586850:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:0.0:1788748441.589598:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.589681:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368663552 00000100:00100000:3.0:1788748441.589704:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368663552 00000100:00100000:3.0:1788748441.589778:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1788748441.589790:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:11405:x1875638368663552:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748441.589833:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748441.589860:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d4a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.589940:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.589957:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.589980:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:3.0:1788748441.589984:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748441.590008:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb800, rc 0) 00000100:00100000:3.0:1788748441.590101:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:11405:x1875638368663552:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 312us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.590109:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1788748441.593102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.593216:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368663680 00000100:00100000:0.0:1788748441.593228:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368663680 00000100:00100000:0.0:1788748441.593307:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1788748441.593357:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368663680:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788748441.593673:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2410:x1875638368663680:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 356us (585us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788748441.593682:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1788748441.596081:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.596177:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368663936 00000100:00100000:2.0:1788748441.596189:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368663936 00000100:00100000:2.0:1788748441.596254:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1788748441.596285:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:11405:x1875638368663936:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788748441.596609:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:11405:x1875638368663936:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 325us (539us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788748441.596617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1788748441.598768:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.598970:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368664192 00000100:00100000:3.0:1788748441.598983:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368664192 00000100:00100000:3.0:1788748441.599067:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:3.0:1788748441.599078:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:11405:x1875638368664192:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748441.599224:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:11405:x1875638368664192:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 148us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.599232:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:3.0:1788748441.601936:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.604647:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368664320 00000100:00100000:0.0:1788748441.604671:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368664320 00000100:00100000:0.0:1788748441.604849:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:0.0:1788748441.604862:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:11405:x1875638368664320:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748441.604891:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748441.604922:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a8a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d51 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.605059:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.605077:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.605092:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748441.605155:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748441.605181:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.605215:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a8a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d51 expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.605240:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d51 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.605263:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:0.0:1788748441.605266:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788748441.605269:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:0.0:1788748441.605397:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:11405:x1875638368664320:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 537us (3471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.605405:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:2.0:1788748441.608803:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.608904:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368664448 00000100:00100000:3.0:1788748441.608916:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368664448 00000100:00100000:3.0:1788748441.609015:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788748441.609035:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2411:x1875638368664448:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748441.609062:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748441.609091:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d58 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748441.609125:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e229a, blocks: 0x0 00010000:00010000:3.0:1788748441.609153:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788748441.609158:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748441.609168:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.609216:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.609230:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbac00, rc 0) 00000100:00100000:3.0:1788748441.609307:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:2411:x1875638368664448:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 282us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.609345:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:0.0:1788748441.612408:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.612578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368664704 00000100:00100000:3.0:1788748441.612593:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368664704 00000100:00100000:3.0:1788748441.612668:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:3.0:1788748441.612680:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:11405:x1875638368664704:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748441.612867:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:11405:x1875638368664704:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 189us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.612875:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:1.0:1788748441.615778:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.615893:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368664832 00000100:00100000:0.0:1788748441.615907:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368664832 00000100:00100000:0.0:1788748441.616093:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1788748441.616105:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:11405:x1875638368664832:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748441.616132:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748441.616155:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d5f expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.616197:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.616208:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748441.616213:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748441.616218:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 11 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.616261:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.616278:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 11 pid: 8427 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.616296:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84942300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388652800:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748441.616812:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaafd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748441.619973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.620073:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368664960 00000100:00100000:1.0:1788748441.620086:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368664960 00010000:00010000:1.0:1788748441.620144:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 12 pid: 8427 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.620200:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:1.0:1788748441.620212:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:2410:x1875638368664960:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748441.620233:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748441.620274:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 12 pid: 8427 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.620291:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 12 pid: 8427 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.620347:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748441.620354:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748441.620365:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.620395:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.620461:0:9515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.620480:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84957100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9515:1875638388652928:192.168.203.22@tcp:105: 00000100:00100000:1.0:1788748441.620598:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748441.623446:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84957100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9515:1875638388652928:192.168.203.22@tcp:105: 00010000:00010000:1.0:1788748441.623483:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748441.623561:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:2410:x1875638368664960:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 3351us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.623576:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00010000:00010000:2.0:1788748441.624696:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d58 expref: 11 pid: 8427 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.624724:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84942300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388652800:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748441.624759:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.624777:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:2.0:1788748441.624849:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:11405:x1875638368664832:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 8747us (9085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.624856:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1788748441.628606:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.628809:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368665088 00000100:00100000:3.0:1788748441.628830:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368665088 00002000:00100000:3.0:1788748441.628892:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8adc84943800 x1875638368665088/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:187/0 lens 504/0 e 0 to 0 dl 1788748452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748441.628904:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84943800 with x1875638368665088 ext(0->12) 00002000:00010000:3.0:1788748441.628912:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc84943800 00000100:00100000:3.0:1788748441.628949:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788748441.628959:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:2411:x1875638368665088:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788748441.630803:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:2411:x1875638368665088:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 1832us (2198us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788748441.630832:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:2.0:1788748441.630845:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8adc84943800 x1875638368665088/t4294967309(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:187/0 lens 504/448 e 0 to 0 dl 1788748452 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748441.630857:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84943800 with x1875638368665088 ext(0->12) 00002000:00010000:2.0:1788748441.630880:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc84943800 00000100:00100000:1.0:1788748441.633364:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.633599:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368665216 00000100:00100000:0.0:1788748441.633613:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368665216 00000100:00100000:0.0:1788748441.633688:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:0.0:1788748441.633718:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:11405:x1875638368665216:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788748441.635550:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788748441.635616:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788748441.635656:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8addb5111c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788748441.635662:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8addbc7e0600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8addb5111e40 00000020:00080000:2.0:1788748441.635666:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8addbc7e0f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc83d39000 00000004:00080000:2.0:1788748441.635692:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788748441.635734:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8adda7301000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788748441.635737:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8add88129f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8adda7301e40 00000020:00080000:2.0:1788748441.635740:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8add91b69500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc83f8e800 00000100:00100000:3.0:1788748441.636023:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388653184:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788748441.636135:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748441.636184:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748441.636191:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388653056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788748441.636215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748441.636266:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388653184 00000100:00100000:3.0:1788748441.636275:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388653184 00000100:00100000:3.0:1788748441.636371:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388653056 00000100:00100000:3.0:1788748441.636375:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388653056 00000100:00100000:3.0:1788748441.636403:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788748441.636413:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388653184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788748441.636446:0:8425:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1788748441.636481:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636795:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636808:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636827:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636834:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748441.636839:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636848:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636869:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8adda17e1c00) 00010000:00010000:0.0:1788748441.636873:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748441.636878:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636886:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1a5bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636916:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636922:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636927:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636946:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bcc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748441.636949:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636956:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636965:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8add91e32b00) 00010000:00010000:0.0:1788748441.636968:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748441.636971:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636977:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1a664 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.636994:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637000:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637006:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637011:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68c00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748441.637014:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637021:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637092:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637104:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788748441.637109:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748441.637113:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637153:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637171:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 11 pid: 8427 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.637201:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84951880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1875638388653312:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748441.637304:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748441.637363:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748441.637375:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388653056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788748441.637397:0:8734:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1788748441.637430:0:8734:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e2299, atime: 0x6a9e2299, ctime: 0x6a9e2299, blocks: 0x8 00010000:00010000:3.0:1788748441.637437:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637448:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788748441.637452:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748441.637459:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637474:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637483:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.637492:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637639:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:0.0:1788748441.637642:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748441.637647:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637653:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68c00/0x9ba0f20a02e1a6e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637668:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637674:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637680:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637685:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748441.637688:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637694:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637701:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add91e32200) 00010000:00010000:0.0:1788748441.637703:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748441.637706:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637712:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1a705 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637735:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637742:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637748:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637754:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748441.637756:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637763:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637771:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748441.637773:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748441.637776:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637782:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1a7d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637792:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637797:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637803:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637824:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748441.637828:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637835:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637845:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:0.0:1788748441.637847:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788748441.637850:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.637856:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a894 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.637984:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11405:x1875638368665216:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 4266us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.637994:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000020:00080000:1.0:1788748441.638615:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788748441.638697:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1788748441.640416:0:8734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748441.640768:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748441.640780:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.640796:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbac00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748441.640801:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.640821:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.640847:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.640855:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050b56769/0x9ba0f20a02e1a8c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.640894:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748441.640896:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748441.640898:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748441.640949:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1875638388653056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3434us (4590us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788748441.640961:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1788748441.641498:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc84953800/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788748441.641509:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388653056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788748441.642497:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.642671:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368665344 00000100:00100000:2.0:1788748441.642683:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368665344 00000100:00100000:2.0:1788748441.642746:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1788748441.642757:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:2410:x1875638368665344:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788748441.643720:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.643752:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368665472 00000100:00100000:1.0:1788748441.643758:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368665472 00010000:00010000:1.0:1788748441.643795:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 13 pid: 8427 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.643859:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:1.0:1788748441.643869:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:2410:x1875638368665472:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748441.643886:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748441.643892:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 13 pid: 8427 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.643908:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 13 pid: 8427 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.643941:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748441.643946:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748441.643953:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.643964:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.643989:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748441.644053:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:2410:x1875638368665472:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 185us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748441.644060:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00010000:00010000:0.0:1788748441.644500:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d562f01f/0x9ba0f20a02e1a672 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3cb7 expref: 12 pid: 8427 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.644532:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84951880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1875638388653312:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748441.644557:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.644568:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.644587:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.644598:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.644606:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.644631:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748441.645076:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748441.645086:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.645111:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748441.645116:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.645126:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.645144:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.645151:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067bf2230/0x9ba0f20a02e1a8be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.645171:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748441.645173:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748441.645174:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788748441.646237:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788748441.646288:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:0.0:1788748441.646468:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388653184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10052us (10328us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788748441.646483:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788748441.646602:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368665344:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 3844us (4108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.646610:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:1.0:1788748441.646736:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788748441.646744:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788748441.646773:0:3636:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8adc84953480 x1875638388653184/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788748457 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788748441.646787:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc84953480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788748441.646797:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388653184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788748441.648948:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.649113:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368665728 00000100:00100000:0.0:1788748441.649126:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368665728 00000100:00100000:0.0:1788748441.649231:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:0.0:1788748441.649248:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11405:x1875638368665728:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748441.649447:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748441.649482:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d51 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.649503:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:0.0:1788748441.649510:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748441.649622:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.649652:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.649665:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748441.649823:0:6511:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001aaaddb9 reply state 00000000c9ebbd6d transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.649837:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.649843:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:0.0:1788748441.649846:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788748441.649849:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748441.649974:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:11405:x1875638368665728:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 733us (1037us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1788748441.649982:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:0.0:1788748441.652910:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.653007:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368665856 00000100:00100000:3.0:1788748441.653022:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368665856 00000100:00100000:3.0:1788748441.653140:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1788748441.653153:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368665856:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788748441.653394:0:8734:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788748441.653399:0:8734:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788748442 00002000:00010000:3.0:1788748441.653402:0:8734:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788748441 00002000:00010000:3.0:1788748441.653404:0:8734:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788748442 -> 1788748442 00002000:00010000:3.0:1788748441.653407:0:8734:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788748441.653478:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368665856:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 327us (581us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788748441.653487:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1788748441.656126:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.656226:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368666112 00000100:00100000:0.0:1788748441.656240:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368666112 00000100:00100000:0.0:1788748441.656369:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:0.0:1788748441.656380:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:11405:x1875638368666112:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788748441.656469:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.656490:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.656537:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.656582:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.656599:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 17 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.656615:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84940000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388653440:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748441.656714:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748441.659830:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.659998:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368666240 00000100:00100000:2.0:1788748441.660011:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368666240 00010000:00010000:2.0:1788748441.660078:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 18 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.660130:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:2.0:1788748441.660141:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:2411:x1875638368666240:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748441.660158:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.660166:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 18 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.660183:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 18 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.660209:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:2.0:1788748441.660234:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.660247:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.660256:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.660280:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748441.660389:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84941880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:2411:x1875638368666240:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 245us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.660397:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00010000:00010000:3.0:1788748441.661959:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a88d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d43 expref: 17 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.661988:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84940000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388653440:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748441.662014:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662189:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662198:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662402:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662411:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662427:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662434:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748441.662438:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662448:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662464:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:3.0:1788748441.662467:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788748441.662472:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.662478:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a8d3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.662571:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11405:x1875638368666112:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 6192us (6455us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788748441.662581:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:3.0:1788748441.665227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748441.665529:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368666368 00000100:00100000:1.0:1788748441.665543:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368666368 00000100:00100000:1.0:1788748441.665620:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1788748441.665632:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368666368:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788748441.665687:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.665713:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.665724:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748441.665729:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788748441.665734:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.665792:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.665808:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 7 pid: 8424 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.665836:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84957800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1875638388653568:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748441.665955:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748441.669386:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.669526:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84957800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1875638388653568:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748441.669564:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.669707:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368666496 00000100:00100000:3.0:1788748441.669717:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368666496 00010000:00010000:3.0:1788748441.669791:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 8 pid: 8424 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.669836:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:3.0:1788748441.669847:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368666496:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748441.669866:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748441.669893:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 8 pid: 8424 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.669908:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 8 pid: 8424 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.669936:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a8b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d5f expref: 8 pid: 8424 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.669955:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748441.669960:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748441.669966:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.669977:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.670010:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748441.670200:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368666496:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 354us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.670209:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00010000:00010000:2.0:1788748441.671291:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671310:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671368:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671378:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671407:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671416:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748441.671421:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671431:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671450:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.671457:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0370746/0x9ba0f20a02e1a8da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.671557:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368666368:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 5924us (6341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.671566:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1788748441.674376:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.674481:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368666752 00000100:00100000:3.0:1788748441.674496:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368666752 00000100:00100000:3.0:1788748441.674581:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:3.0:1788748441.674593:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:11405:x1875638368666752:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788748441.674700:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.674722:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.674735:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.674779:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.674797:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 16 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.674824:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388653696:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748441.674942:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748441.677467:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388653696:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748441.677533:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.679042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.679736:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368666880 00000100:00100000:2.0:1788748441.679749:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368666880 00010000:00010000:2.0:1788748441.679807:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 17 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.679866:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:2.0:1788748441.679899:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:2410:x1875638368666880:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748441.679920:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.679928:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 17 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.679945:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 17 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.679971:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1a7d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d0b expref: 17 pid: 6512 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.679989:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.679996:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 16 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.680008:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.680016:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.680024:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.680073:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748441.680134:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:2410:x1875638368666880:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 238us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.680143:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00010000:00010000:3.0:1788748441.680218:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.680228:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.680486:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.680513:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.680523:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.680558:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.680575:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 16 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.680591:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84951180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388653824:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748441.680664:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748441.683598:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.683745:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368667008 00000100:00100000:0.0:1788748441.683756:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368667008 00010000:00010000:0.0:1788748441.683805:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 17 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748441.683861:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1788748441.683872:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:2411:x1875638368667008:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748441.683889:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748441.683897:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 17 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.683913:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 17 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.683967:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:0.0:1788748441.683973:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.683985:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.683995:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748441.684019:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748441.684096:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+17:2411:x1875638368667008:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 226us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.684105:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00010000:00010000:1.0:1788748441.684279:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1a89b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d4a expref: 16 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.684303:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84951180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388653824:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748441.684363:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.684374:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.684380:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748441.684539:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788748441.684687:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788748441.684727:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788748441.684827:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84955880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875638388653952:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788748441.684892:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748441.684929:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc841453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748441.685072:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388653952 00000100:00100000:2.0:1788748441.685090:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388653952 00000100:00100000:2.0:1788748441.685130:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788748441.685139:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6510:x1875638388653952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788748441.685240:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6510:x1875638388653952:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.685248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788748441.685345:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84955880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875638388653952:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788748441.685471:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788748441.685723:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84955880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875638388654080:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788748441.685759:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748441.685834:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748441.687578:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388654080 00000100:00100000:0.0:1788748441.687594:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388654080 00000100:00100000:0.0:1788748441.687706:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788748441.687717:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6510:x1875638388654080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788748441.688004:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6510:x1875638388654080:12345-0@lo:1000:mdt00_000.0 Request processed in 289us (2243us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788748441.688013:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788748441.688172:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84955880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875638388654080:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788748441.688715:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688731:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688742:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688749:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbbe00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.688756:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688766:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688785:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:1.0:1788748441.688789:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748441.688795:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688802:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a8e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688850:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688858:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688865:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688892:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.688895:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688903:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688912:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.688915:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748441.688925:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 19 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688939:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 19 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688951:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 19 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.688996:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 19 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748441.689014:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84955c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388654208:192.168.203.22@tcp:105: 00000100:00100000:1.0:1788748441.689271:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc841453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748441.694647:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748441.694726:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368667136 00000100:00100000:0.0:1788748441.694738:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368667136 00000100:00100000:0.0:1788748441.694805:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788748441.694834:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11404:x1875638368667136:12345-192.168.203.22@tcp:49:lfs.0 00000100:00100000:1.0:1788748441.695643:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84955c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388654208:192.168.203.22@tcp:105: 00010000:00010000:1.0:1788748441.695679:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695714:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1a82b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695753:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695770:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695784:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695794:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695800:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695873:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695882:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.695886:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695894:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695908:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.695911:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748441.695915:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695928:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1a8ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695939:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695945:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695951:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695955:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748441.695958:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695963:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695971:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748441.695973:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748441.695976:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748441.695980:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a8e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748441.696434:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748441.696440:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748441.697046:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788748441.697489:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788748441.697910:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:11404:x1875638368667136:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 3074us (3269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748441.697935:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:1.0:1788748441.698808:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11405:x1875638368666752:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 24210us (24439us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788748441.698830:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 139 00000020:00080000:1.0:1788748441.698837:0:6510:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788748441.703231:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.703949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368667392 00000100:00100000:3.0:1788748441.703966:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368667392 00000100:00100000:3.0:1788748441.704048:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:3.0:1788748441.704060:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11404:x1875638368667392:12345-192.168.203.22@tcp:58:lfs.0 00000040:00080000:3.0:1788748441.704290:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788748441.704411:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11404:x1875638368667392:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 353us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748441.704420:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:0.0:1788748441.706597:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.706721:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368667648 00000100:00100000:2.0:1788748441.706732:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368667648 00000100:00100000:2.0:1788748441.706796:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:2.0:1788748441.706807:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda703a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:11405:x1875638368667648:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788748441.707209:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788748441.707262:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788748441.707306:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707361:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707376:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707386:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707392:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707398:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707442:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748441.707491:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748441.707498:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707516:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748441.707521:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707530:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707544:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:2.0:1788748441.707547:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788748441.707553:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707559:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1a8f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.707572:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748441.707574:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748441.707576:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748441.707663:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda703a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:11405:x1875638368667648:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 856us (1525us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788748441.707672:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000020:00080000:2.0:1788748441.707679:0:6513:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788748441.741642:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.741778:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368667776 00000100:00100000:3.0:1788748441.741791:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368667776 00000100:00100000:3.0:1788748441.741877:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:3.0:1788748441.741890:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:11407:x1875638368667776:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748441.741947:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748441.741975:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a8fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d66 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742070:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742089:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742102:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742121:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742128:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742145:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742242:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742642:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742652:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742697:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.742726:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 22 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748441.742742:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84952d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388654336:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748441.742876:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748441.746185:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748441.746357:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84952d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8447:1875638388654336:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748441.746391:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.746631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368668032 00000100:00100000:2.0:1788748441.746641:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368668032 00000100:00100000:2.0:1788748441.746726:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1788748441.746737:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:6181:x1875638368668032:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788748441.747041:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:6181:x1875638368668032:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 304us (870us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788748441.747049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1788748441.750482:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748441.750641:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368668160 00000100:00100000:2.0:1788748441.750654:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368668160 00010000:00010000:2.0:1788748441.750706:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 24 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748441.750754:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1788748441.750764:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:2410:x1875638368668160:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748441.750783:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748441.750791:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 24 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.750808:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 24 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.750846:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a81d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d27 expref: 24 pid: 6510 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.750866:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.750873:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.750884:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.750911:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.751036:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748441.751106:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:2410:x1875638368668160:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 343us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.751114:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00010000:00010000:3.0:1788748441.753407:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748441.753431:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748441.753692:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788748441.753699:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748441.753729:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753750:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753764:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753772:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753780:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753788:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748441.753793:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753801:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753859:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748441.753862:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748441.753869:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753876:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1a904 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753897:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753904:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753909:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753914:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748441.753917:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753924:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753931:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8add864c2b00) 00010000:00010000:2.0:1788748441.753934:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748441.753937:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.753942:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1a90b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.754011:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1a8fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d66 expref: 23 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.754110:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d66 expref: 22 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748441.754120:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748441.754122:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748441.754125:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbbe00, rc 0) 00000100:00100000:2.0:1788748441.754520:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:11407:x1875638368667776:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 12619us (12880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748441.754531:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00010000:00010000:3.0:1788748441.959986:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748442.405491:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748442.405599:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388654464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748442.405703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748442.405934:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388654464 00000100:00100000:3.0:1788748442.405946:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388654464 00000100:00100000:3.0:1788748442.406020:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788748442.406033:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388654464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788748442.406084:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788748442.406147:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388654464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748442.406155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788748442.406457:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388654464:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788748442.724498:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748442.724510:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748442.724539:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788748442.724562:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748442.724714:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84956680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388654592:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788748442.724851:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a53f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748442.736589:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748442.736628:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368668288 00000100:00100000:3.0:1788748442.736647:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368668288 00000100:00100000:3.0:1788748442.736711:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:3.0:1788748442.736722:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:11418:x1875638368668288:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788748442.736775:0:6510:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788748442.736909:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:11418:x1875638368668288:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748442.736916:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00080000:3.0:1788748442.736937:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748442.738923:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84956680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388654592:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788748442.741226:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748442.741350:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368668544 00000100:00100000:0.0:1788748442.741365:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368668544 00000100:00100000:0.0:1788748442.741452:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:0.0:1788748442.741465:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:11418:x1875638368668544:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748442.741485:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748442.741531:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a919 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d6d expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.741649:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a920 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.741665:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.741681:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748442.741693:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788748442.741805:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a919 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d6d expref: 25 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.741848:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a920 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d6d expref: 24 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748442.741857:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748442.741861:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748442.741865:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a800, rc 0) 00000100:00100000:0.0:1788748442.741941:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:11418:x1875638368668544:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 478us (726us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788748442.745279:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:1.0:1788748442.759823:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748442.759976:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368668800 00000100:00100000:2.0:1788748442.759987:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368668800 00000100:00100000:2.0:1788748442.760046:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:2.0:1788748442.760057:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:11418:x1875638368668800:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788748442.760141:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760159:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760172:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760372:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760397:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760405:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760411:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748442.760416:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760424:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760436:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748442.760439:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748442.760444:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748442.760450:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1a92e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748442.760574:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:11418:x1875638368668800:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 517us (767us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788748442.760582:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 144 00000040:00080000:1.0:1788748442.760992:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748442.760998:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748442.761803:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788748442.761836:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788748442.763449:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748442.765513:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368668928 00000100:00100000:3.0:1788748442.765526:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368668928 00000100:00100000:3.0:1788748442.765732:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1788748442.765745:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:2411:x1875638368668928:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748442.765761:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748442.765800:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a920 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d6d expref: 25 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748442.765830:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:3.0:1788748442.765835:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748442.765897:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:2411:x1875638368668928:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 155us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748442.765906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1788748442.766074:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748442.766148:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368669184 00000100:00100000:3.0:1788748442.766152:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368669184 00000100:00100000:3.0:1788748442.766177:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1788748442.766184:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:11418:x1875638368669184:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788748442.766520:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:11418:x1875638368669184:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 335us (446us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788748442.766528:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000040:00080000:0.0:1788748442.806032:0:14302:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748442.806042:0:14302:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748442.806076:0:14302:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788748442.806084:0:14302:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788748442.985417:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748442.998780:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748442.998827:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368669440 00000100:00100000:1.0:1788748442.998837:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368669440 00000100:00100000:1.0:1788748442.998892:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:1.0:1788748442.998901:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:11432:x1875638368669440:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748442.998923:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748442.998941:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a935 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d74 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748442.999041:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a93c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748442.999067:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748442.999080:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a93c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748442.999093:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788748442.999213:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1a935 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d74 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748442.999237:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a93c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d74 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748442.999245:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:1.0:1788748442.999248:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788748442.999251:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69a00, rc 0) 00000100:00100000:1.0:1788748442.999302:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:11432:x1875638368669440:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 403us (532us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788748442.999308:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:2.0:1788748443.011718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748443.011785:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368669568 00000100:00100000:0.0:1788748443.011796:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368669568 00000100:00100000:0.0:1788748443.011862:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:0.0:1788748443.011873:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:11432:x1875638368669568:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788748443.011957:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.011977:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.011989:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.012053:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.012061:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.012069:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.012075:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748443.012080:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.012086:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.012099:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:0.0:1788748443.012102:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748443.012107:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.012112:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1a94a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748443.012197:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:11432:x1875638368669568:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 325us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748443.012204:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:1.0:1788748443.096999:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748443.097100:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368669696 00000100:00100000:3.0:1788748443.097110:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368669696 00000100:00080000:0.0:1788748443.097175:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748443.097460:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788748443.097473:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368669696:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1788748443.097517:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748443.097539:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a951 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d7b expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748443.097562:0:8734:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e229a, atime: 0x6a9e2299, ctime: 0x6a9e229a, blocks: 0x8 00010000:00010000:0.0:1788748443.097581:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1788748443.097585:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748443.097594:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a951 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d7b expref: 7 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.097611:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a951 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d7b expref: 7 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748443.097623:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748443.097679:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368669696:12345-192.168.203.22@tcp:101:cat.0 Request processed in 210us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748443.097685:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1788748443.103731:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748443.103790:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368669824 00000100:00100000:1.0:1788748443.103799:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368669824 00002000:00100000:1.0:1788748443.103861:0:8432:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8adc84950a80 x1875638368669824/t0(0) o3->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:189/0 lens 488/0 e 0 to 0 dl 1788748454 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748443.103873:0:8432:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84950a80 with x1875638368669824 ext(0->4095) 00002000:00010000:1.0:1788748443.103879:0:8432:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc84950a80 00000100:00100000:1.0:1788748443.103958:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1788748443.103980:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368669824:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:1.0:1788748443.104599:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368669824:12345-192.168.203.22@tcp:3:cat.0 Request processed in 618us (873us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788748443.104607:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00100000:1.0:1788748443.104615:0:8432:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8adc84950a80 x1875638368669824/t0(0) o3->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:189/0 lens 488/4536 e 0 to 0 dl 1788748454 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788748443.104623:0:8432:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84950a80 with x1875638368669824 ext(0->4095) 00002000:00010000:1.0:1788748443.104627:0:8432:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc84950a80 00010000:00010000:1.0:1788748444.006000:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748444.458272:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388654720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748444.458363:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748444.458444:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388654720 00000100:00100000:1.0:1788748444.458452:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388654720 00000100:00100000:1.0:1788748444.458494:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788748444.458516:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388654720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748444.458551:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788748444.458597:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388654720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.458603:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788748444.458653:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388654720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748444.969376:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388654848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748444.969466:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748444.970227:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388655360:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.970276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748444.970306:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388655872:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.970359:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748444.970378:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388656384:0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.970567:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388655360 00000100:00100000:3.0:1788748444.970576:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388655360 00000100:00100000:3.0:1788748444.970786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788748444.970806:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388655360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.970867:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388655360:12345-0@lo:400:kworker.0 Request processed in 72us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748444.970874:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788748444.971358:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748444.971415:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388655360:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.971433:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788748444.971442:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388654976:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.971472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748444.971814:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388655488:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.971845:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748444.972740:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388654976 00000100:00100000:1.0:1788748444.972752:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388654976 00000100:00100000:1.0:1788748444.972813:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788748444.972822:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388654976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.972884:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda710f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3635:x1875638388654976:12345-0@lo:400:kworker.0 Request processed in 63us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.972905:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788748444.972941:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388655872 00000100:00100000:1.0:1788748444.972945:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388655872 00000100:00100000:1.0:1788748444.972978:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656384 00000100:00100000:1.0:1788748444.972981:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656384 00000100:00100000:1.0:1788748444.973003:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788748444.973010:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388655872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.973045:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388655872:12345-0@lo:400:kworker.0 Request processed in 36us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.973051:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788748444.973062:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788748444.973068:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388656384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.973096:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388656384:12345-0@lo:400:kworker.0 Request processed in 28us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.973102:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788748444.973122:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388654848 00000100:00100000:1.0:1788748444.973126:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388654848 00000100:00100000:1.0:1788748444.973152:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788748444.973159:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388654848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748444.973180:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748444.973217:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388654848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.973222:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788748444.973242:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388655232:0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.973266:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748444.973290:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388655744:0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.973346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748444.973360:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388656256:0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.973378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748444.973393:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788748444.973398:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388655104:0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.973622:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388656512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748444.973653:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748444.973760:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656512 00000100:00100000:1.0:1788748444.973764:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656512 00000100:00100000:1.0:1788748444.973790:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788748444.973804:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875638388656512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748444.973815:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748444.973842:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875638388656512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.973847:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788748444.973861:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388655744 00000100:00100000:1.0:1788748444.973863:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388655744 00000100:00100000:1.0:1788748444.973876:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656256 00000100:00100000:1.0:1788748444.973878:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656256 00000100:00100000:1.0:1788748444.973886:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788748444.973891:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388655744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.973962:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388655744:12345-0@lo:400:kworker.0 Request processed in 70us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.973966:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788748444.973974:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788748444.973978:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbcace050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388656256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.974007:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbcace050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388656256:12345-0@lo:400:kworker.0 Request processed in 28us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.974023:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788748444.974241:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388656512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748444.977425:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388655488 00000100:00100000:1.0:1788748444.977439:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388655488 00000100:00080000:0.0:1788748444.977467:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748444.977471:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748444.977474:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748444.977489:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388655232 00000100:00100000:0.0:1788748444.977493:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388655232 00000100:00100000:1.0:1788748444.977496:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788748444.977506:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388655488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748444.977597:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388655488:12345-0@lo:400:kworker.0 Request processed in 92us (5750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748444.977604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788748444.977882:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb3929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388655488:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.977895:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388656000:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.977939:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748444.977963:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656000 00000100:00100000:2.0:1788748444.977967:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656000 00000100:00100000:2.0:1788748444.977998:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788748444.978134:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748444.978160:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388655616:0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.978187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748444.978207:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388656128:0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.978226:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748444.978248:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388655744:0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.978260:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388656256:0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.978291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388655104 00000100:00100000:3.0:1788748444.978295:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388655104 00000100:00100000:3.0:1788748444.978310:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388655616 00000100:00100000:3.0:1788748444.978314:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388655616 00000100:00100000:3.0:1788748444.978351:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656128 00000100:00100000:3.0:1788748444.978354:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656128 00000100:00100000:3.0:1788748444.978378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788748444.978384:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388655104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.978422:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388655104:12345-0@lo:400:kworker.0 Request processed in 38us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748444.978428:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788748444.978443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788748444.978448:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388655616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.978475:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388655616:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748444.978480:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788748444.978667:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788748444.978675:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388655232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748444.978714:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388655232:12345-0@lo:400:kworker.0 Request processed in 40us (5447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748444.978822:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788748444.978847:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788748444.978854:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388656128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748444.978887:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388656128:12345-0@lo:400:kworker.0 Request processed in 35us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748444.978893:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788748444.978945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388655104:0@lo:400:kworker.0 00010000:00080000:3.0:1788748444.978959:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc825c3b80 x1875638388655616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748444.978970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388655616:0@lo:400:kworker.0 00010000:00080000:3.0:1788748444.978980:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add812ace00 x1875638388656128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748444.978989:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388656128:0@lo:400:kworker.0 00000100:00100000:3.0:1788748444.979000:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388655232:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.979108:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388656000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.979145:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388656000:12345-0@lo:400:kworker.0 Request processed in 1141us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748444.979151:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788748444.979187:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388656000:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.979208:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388654848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748444.979231:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388655872:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.979242:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388656384:0@lo:400:kworker.0 00000100:00100000:2.0:1788748444.979268:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388654976:0@lo:400:kworker.0 00000100:00080000:0.0:1788748444.980283:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748444.980291:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788748445.034184:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788748445.040232:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748445.477056:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388656640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748445.477125:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748445.477205:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656640 00000100:00100000:1.0:1788748445.477213:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656640 00000100:00100000:1.0:1788748445.477271:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788748445.477280:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388656640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748445.477309:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788748445.477381:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388656640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748445.477387:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788748445.477436:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388656640:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1788748445.477743:0:8741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362464425113ns, next at 363464422383ns, rc = 0 00000100:00100000:2.0:1788748445.477775:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748445.477784:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388656768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748445.477825:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748445.477852:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656768 00000100:00100000:2.0:1788748445.477857:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656768 00000100:00100000:2.0:1788748445.477884:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788748445.477890:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875638388656768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748445.477901:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788748445.477931:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875638388656768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748445.477937:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788748445.477965:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388656768:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788748445.863588:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748445.863598:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748445.863631:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788748445.863654:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788748446.052583:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748446.518614:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748446.518654:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748446.518677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748446.518704:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748446.518719:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748446.518732:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748446.518753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748446.518778:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670464 00000100:00100000:1.0:1788748446.518796:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670464 00000100:00100000:1.0:1788748446.518844:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670336 00000100:00100000:1.0:1788748446.518846:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670336 00000100:00100000:1.0:1788748446.518863:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:1.0:1788748446.518872:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368670464:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748446.518933:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368670464:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 63us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748446.518940:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:1.0:1788748446.518954:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:1.0:1788748446.518960:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368670336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748446.518982:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368670336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748446.518988:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:0.0:1788748446.519456:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368669952 00000100:00100000:0.0:1788748446.519462:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368669952 00000100:00100000:0.0:1788748446.519518:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 382 00000100:00100000:0.0:1788748446.519526:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368669952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748446.519557:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2412:x1875638368669952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 32us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748446.519563:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 382 00000100:00100000:0.0:1788748446.519593:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670208 00000100:00100000:0.0:1788748446.519597:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670208 00000100:00100000:0.0:1788748446.519623:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670720 00000100:00100000:0.0:1788748446.519626:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670720 00000100:00100000:0.0:1788748446.519640:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670080 00000100:00100000:0.0:1788748446.519642:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670080 00000100:00100000:0.0:1788748446.519656:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670592 00000100:00100000:0.0:1788748446.519659:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670592 00000100:00100000:0.0:1788748446.519673:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 285 00000100:00100000:0.0:1788748446.519679:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368670208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748446.519708:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368670208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748446.519728:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 285 00000100:00100000:0.0:1788748446.519741:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 286 00000100:00100000:0.0:1788748446.519747:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368670720:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748446.519772:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368670720:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748446.519777:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 286 00000100:00100000:0.0:1788748446.519799:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00100000:0.0:1788748446.519806:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:2412:x1875638368670080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748446.519828:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:2412:x1875638368670080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748446.519833:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00100000:0.0:1788748446.519843:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 288 00000100:00100000:0.0:1788748446.519849:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368670592:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748446.519870:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2412:x1875638368670592:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 21us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748446.519875:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 288 00000100:00080000:0.0:1788748446.519891:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748446.519894:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748446.519897:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748446.519899:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788748447.022888:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788748447.022904:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000004:00080000:1.0:1788748447.024307:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:1.0:1788748447.024363:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788748447.024401:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8addbc7df240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788748447.024406:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adda7318600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8addbc7dfe40 00000020:00080000:1.0:1788748447.024419:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adda7318300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8addb532c000 00000020:00080000:1.0:1788748447.024443:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788748447.024456:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788748447.024534:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788748447.024563:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748447.024574:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748447.024582:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748447.024587:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748447.024592:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748447.024599:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748447.024632:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8add864c2400) 00010000:00010000:1.0:1788748447.024636:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748447.024641:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748447.024647:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a8cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748447.025188:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748447.025209:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388656896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788748447.025279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748447.025379:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388656896 00000100:00100000:3.0:1788748447.025386:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388656896 00000100:00100000:3.0:1788748447.025450:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788748447.025460:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875638388656896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788748447.025595:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788748447.025599:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788748442 -> 1788748442 00002000:00010000:3.0:1788748447.025601:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788748441 -> 1788748441 00002000:00010000:3.0:1788748447.025618:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788748442 -> 1788748442 00002000:00010000:3.0:1788748447.025621:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788748447.025662:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3636:x1875638388656896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (382us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788748447.025670:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788748447.025690:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788748447.025721:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc84950e00/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788748447.025727:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388656896:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788748447.026815:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788748447.026826:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1788748447.076550:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748447.524592:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748447.524624:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388657024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748447.524715:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748447.524809:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657024 00000100:00100000:1.0:1788748447.524818:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657024 00000100:00100000:1.0:1788748447.524876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788748447.524886:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388657024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748447.524931:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788748447.524984:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388657024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748447.524992:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788748447.525046:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc81e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388657024:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788748448.100804:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748448.143597:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748448.143691:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670848 00000100:00100000:0.0:1788748448.143701:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670848 00000100:00080000:3.0:1788748448.143826:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748448.148759:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:0.0:1788748448.148795:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11085:x1875638368670848:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788748448.148953:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11085:x1875638368670848:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 181us (5364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748448.148961:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:3.0:1788748448.160152:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748448.160609:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368670976 00000100:00100000:2.0:1788748448.160620:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368670976 00000100:00100000:2.0:1788748448.160700:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:2.0:1788748448.160711:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:11085:x1875638368670976:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788748448.160792:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748448.160829:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:11085:x1875638368670976:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 121us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748448.160853:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:2.0:1788748448.170216:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748448.171066:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368671232 00000100:00100000:3.0:1788748448.171078:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368671232 00000100:00100000:3.0:1788748448.171145:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1788748448.171156:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:11085:x1875638368671232:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788748448.171425:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:11085:x1875638368671232:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 270us (1217us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788748448.171434:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00010000:00010000:0.0:1788748449.125207:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748449.574405:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748449.574433:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388657152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748449.574534:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748449.575929:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657152 00000100:00100000:2.0:1788748449.575945:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657152 00000100:00100000:2.0:1788748449.576028:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788748449.576039:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388657152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748449.576087:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748449.576196:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388657152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748449.576205:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788748449.576276:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388657152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748450.084959:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748450.084990:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388657280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748450.085076:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.085147:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657280 00000100:00100000:3.0:1788748450.085157:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657280 00000100:00100000:3.0:1788748450.085246:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788748450.085258:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388657280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748450.085295:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748450.085377:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388657280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748450.085384:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788748450.085515:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788748450.085522:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788748450.085549:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc84953800, transno 4294967305 00000100:00100000:1.0:1788748450.085568:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388657280:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788748450.085624:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748450.087081:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748450.087104:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388657408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748450.087178:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748450.087232:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388657536:0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.087243:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388657792:0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.087412:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388657920:0@lo:400:kworker.0 00000100:00100000:0.0:1788748450.088715:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657408 00000100:00100000:0.0:1788748450.088731:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657408 00000100:00100000:0.0:1788748450.088835:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788748450.088846:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388657408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788748450.088882:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748450.096566:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.096646:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388658304:0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.096690:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.099633:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388658816:0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.100009:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.100051:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788748450.100059:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388657664:0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.100098:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.100129:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388658176:0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.100153:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.100399:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388658688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.100427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.100488:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658304 00000100:00100000:3.0:1788748450.100499:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658304 00000100:00100000:1.0:1788748450.100544:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.100572:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658816 00000100:00100000:3.0:1788748450.100575:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658816 00000100:00100000:1.0:1788748450.100581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657792 00000100:00100000:1.0:1788748450.100585:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657792 00000100:00100000:3.0:1788748450.100589:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657664 00000100:00100000:3.0:1788748450.100592:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657664 00000100:00100000:3.0:1788748450.100603:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658176 00000100:00100000:3.0:1788748450.100605:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658176 00000100:00100000:3.0:1788748450.100617:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658688 00000100:00100000:1.0:1788748450.100617:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788748450.100619:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658688 00000100:00100000:1.0:1788748450.100627:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388657792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.100633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788748450.100639:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388658304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.100770:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748450.100797:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388658432:0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.100837:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748450.100876:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658432 00000100:00100000:2.0:1788748450.100879:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658432 00000100:00100000:2.0:1788748450.100912:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788748450.100920:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388658432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.100958:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388658432:12345-0@lo:400:kworker.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748450.100965:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788748450.101016:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388658432:0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.101072:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657920 00000100:00100000:2.0:1788748450.101075:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657920 00000100:00100000:2.0:1788748450.101095:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788748450.101111:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388658816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.101177:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388658304:12345-0@lo:400:kworker.0 Request processed in 538us (4485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748450.101185:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788748450.101202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788748450.101208:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388657664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748450.101209:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788748450.101219:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388658176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748450.108478:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388657792:12345-0@lo:400:kworker.0 Request processed in 7833us (11903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748450.108502:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788748450.108579:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388657536 00000100:00100000:1.0:1788748450.108592:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388657536 00000100:00100000:1.0:1788748450.108665:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788748450.108676:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388657536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748450.108778:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add91b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388657536:12345-0@lo:400:kworker.0 Request processed in 103us (8233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748450.108785:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788748450.108952:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388658816:12345-0@lo:400:kworker.0 Request processed in 7838us (8942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748450.108963:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788748450.108990:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788748450.109000:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388658688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748450.109024:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388657536:0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.109037:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388658688:12345-0@lo:400:kworker.0 Request processed in 42us (8610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748450.109040:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388658048:0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.109043:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788748450.109056:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788748450.109062:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388657920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748450.109081:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748450.109097:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388657920:12345-0@lo:400:kworker.0 Request processed in 35us (8339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748450.109103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788748450.109113:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658048 00000100:00100000:1.0:1788748450.109117:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658048 00000100:00100000:1.0:1788748450.109144:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788748450.109150:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388658048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748450.109182:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388658048:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748450.109188:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788748450.109215:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388658048:0@lo:400:kworker.0 00000100:00100000:1.0:1788748450.109222:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388658560:0@lo:400:kworker.0 00000100:00100000:1.0:1788748450.109250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748450.109296:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388657920:0@lo:400:kworker.0 00000100:00080000:1.0:1788748450.109363:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748450.109371:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748450.109388:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748450.109392:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748450.109428:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388657408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 20583us (22249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748450.109437:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788748450.109482:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388657408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748450.112997:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388657664:12345-0@lo:400:kworker.0 Request processed in 11774us (12883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748450.113017:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788748450.113089:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658560 00000100:00100000:3.0:1788748450.113101:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658560 00000100:00100000:3.0:1788748450.113345:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788748450.113356:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388658560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748450.113454:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83f81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388658560:12345-0@lo:400:kworker.0 Request processed in 101us (4203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748450.113461:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788748450.113517:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788748450.113524:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc84953480, transno 4294967310 00000004:00080000:3.0:1788748450.113536:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788748450.113585:0:3636:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8adc84950e00 x1875638388656896/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788748463 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748450.113599:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388658560:0@lo:400:kworker.0 00000100:00080000:1.0:1788748450.113832:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748450.115124:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388657664:0@lo:400:kworker.0 00000100:00100000:0.0:1788748450.124694:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388658176:12345-0@lo:400:kworker.0 Request processed in 23462us (24524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748450.124714:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788748450.132661:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388658176:0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.132687:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388658688:0@lo:400:kworker.0 00000100:00100000:2.0:1788748450.132834:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388657792:0@lo:400:kworker.0 00010000:00080000:2.0:1788748450.132854:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc825c2d80 x1875638388658304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748450.132867:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388658304:0@lo:400:kworker.0 00010000:00080000:2.0:1788748450.132985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adda73a1500 x1875638388658816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748450.132995:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adda73a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388658816:0@lo:400:kworker.0 00010000:00010000:2.0:1788748450.150755:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748450.341660:0:14500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:34:09 (1788748449) 00000100:00100000:3.0:1788748450.598622:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748450.598653:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388658944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748450.598745:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748450.598845:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388658944 00000100:00100000:3.0:1788748450.598854:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388658944 00000100:00100000:3.0:1788748450.598915:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788748450.598925:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388658944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748450.598964:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788748450.599018:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388658944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748450.599026:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788748450.599084:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388658944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748450.605959:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748450.605990:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388659072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748450.606081:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748450.606157:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388659072 00000100:00100000:1.0:1788748450.606177:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388659072 00000100:00100000:1.0:1788748450.606241:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788748450.606252:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388659072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748450.606284:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788748450.606380:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388659072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748450.606388:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788748450.606444:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388659072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788748451.176124:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748451.644478:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748451.644526:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748451.644563:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748451.644596:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748451.644620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748451.644785:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368671360 00000100:00100000:1.0:1788748451.644798:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368671360 00000100:00100000:3.0:1788748451.644821:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748451.644858:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748451.644865:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 384 00000100:00100000:1.0:1788748451.644876:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368671360:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748451.644967:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368671360:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 92us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748451.644975:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 384 00000100:00100000:1.0:1788748451.645191:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368671872 00000100:00100000:1.0:1788748451.645217:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368671872 00000100:00100000:1.0:1788748451.645258:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368671744 00000100:00100000:1.0:1788748451.645261:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368671744 00000100:00100000:1.0:1788748451.645283:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:1.0:1788748451.645291:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368671872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748451.645366:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368671872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 75us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748451.645373:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:1.0:1788748451.645388:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:1.0:1788748451.645394:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368671744:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748451.645420:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368671744:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748451.645427:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00080000:1.0:1788748451.645444:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748451.645449:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748451.645606:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368671616 00000100:00100000:2.0:1788748451.645612:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368671616 00000100:00100000:2.0:1788748451.645657:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368672128 00000100:00100000:2.0:1788748451.645661:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368672128 00000100:00100000:2.0:1788748451.645680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368671488 00000100:00100000:2.0:1788748451.645683:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368671488 00000100:00100000:2.0:1788748451.645701:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:2.0:1788748451.645708:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368671616:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748451.645761:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368671616:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748451.645768:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:2.0:1788748451.645783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 296 00000100:00100000:2.0:1788748451.645790:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368672128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748451.645813:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368672128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748451.645819:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 296 00000100:00100000:2.0:1788748451.645830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:2.0:1788748451.645836:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:2413:x1875638368671488:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748451.645864:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:2413:x1875638368671488:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748451.645879:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00080000:2.0:1788748451.645896:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788748451.645899:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748451.656639:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368672000 00000100:00100000:2.0:1788748451.656661:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368672000 00000100:00100000:1.0:1788748451.656871:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:1.0:1788748451.656888:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368672000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748451.657012:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368672000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 129us (12153us total) trans 0 rc 0/0 00000100:00080000:3.0:1788748451.659183:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748451.664513:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:2.0:1788748451.721380:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748451.721484:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368672384 00000100:00100000:0.0:1788748451.721498:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368672384 00000100:00100000:0.0:1788748451.721663:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:0.0:1788748451.721676:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:12149:x1875638368672384:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748451.721704:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748451.721728:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a958 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d82 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722174:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722194:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722207:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722224:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722231:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722238:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722403:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a96d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722414:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a96d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.722422:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a96d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748451.722434:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788748451.722978:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723004:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723012:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723018:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748451.723024:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723033:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723049:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8addba6a9900) 00010000:00010000:0.0:1788748451.723052:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748451.723059:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723066:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a95f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723719:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723732:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723739:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723745:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748451.723769:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723775:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723786:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8adda17e1200) 00010000:00010000:0.0:1788748451.723789:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748451.723793:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.723799:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a966 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.724314:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1a958 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d82 expref: 17 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.724382:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a96d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d82 expref: 16 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748451.724390:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:0.0:1788748451.724392:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748451.724395:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a600, rc 0) 00000100:00100000:0.0:1788748451.724485:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:12149:x1875638368672384:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2811us (3118us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788748451.724495:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:0.0:1788748451.733161:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748451.734086:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748451.734403:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368672640 00000100:00100000:3.0:1788748451.734417:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368672640 00000100:00100000:3.0:1788748451.734540:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788748451.735883:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:2412:x1875638368672640:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748451.735918:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748451.735955:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1a96d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d82 expref: 16 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748451.735983:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:3.0:1788748451.735989:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748451.736078:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84943480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:2412:x1875638368672640:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1527us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748451.736089:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1788748451.737403:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368672512 00000100:00100000:2.0:1788748451.737424:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368672512 00000100:00100000:2.0:1788748451.737500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:2.0:1788748451.737578:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:12149:x1875638368672512:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788748451.737711:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:12149:x1875638368672512:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 138us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748451.738172:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:0.0:1788748451.741112:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748451.749525:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368672768 00000100:00100000:2.0:1788748451.749549:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368672768 00000100:00100000:2.0:1788748451.749642:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:2.0:1788748451.749657:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:12149:x1875638368672768:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788748451.749811:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:12149:x1875638368672768:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 157us (8708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748451.749819:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 151 00000040:00080000:2.0:1788748452.005638:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748452.005652:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748452.006222:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788748452.006238:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788748452.197821:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748452.197983:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748452.645530:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388659200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748452.645629:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748452.645781:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388659200 00000100:00100000:1.0:1788748452.645792:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388659200 00000100:00100000:1.0:1788748452.645862:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748452.645875:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388659200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748452.645921:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788748452.646019:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388659200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748452.646036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788748452.647014:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388659200:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788748453.169264:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1788748453.170370:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1788748453.170391:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788748453.170792:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788748453.170812:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788748453.220773:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748453.800352:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748453.800639:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368672896 00000100:00100000:2.0:1788748453.800654:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368672896 00000100:00100000:2.0:1788748453.800757:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:2.0:1788748453.800771:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:12192:x1875638368672896:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748453.800799:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748453.800826:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a97b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d89 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.800910:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.800929:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.800953:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.800971:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.800978:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.800986:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801063:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801071:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801079:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801086:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748453.801090:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801098:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801113:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:2.0:1788748453.801117:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748453.801123:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801131:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801144:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801150:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801156:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801168:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748453.801171:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801178:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801186:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adc82598800) 00010000:00010000:2.0:1788748453.801188:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748453.801191:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801197:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a989 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801235:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a97b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d89 expref: 14 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801246:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:2.0:1788748453.801262:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748453.801266:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a97b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d89 expref: 14 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.801275:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bda00, rc 0) 00000100:00100000:2.0:1788748453.801381:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:12192:x1875638368672896:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 614us (1044us total) trans 0 rc 301/301 00000100:00100000:2.0:1788748453.801390:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00080000:3.0:1788748453.802907:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748453.805561:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748453.806592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368673152 00000100:00100000:2.0:1788748453.806614:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368673152 00000100:00100000:2.0:1788748453.806683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:2.0:1788748453.806695:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:12192:x1875638368673152:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:2.0:1788748453.806773:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748453.806809:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fb200/0x9ba0f20a02e1a2dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bb4 expref: 13 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.806831:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259c100) 00010000:00010000:2.0:1788748453.806846:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748453.806923:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.806937:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.806948:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.806960:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.806967:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.806973:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810238:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810278:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810304:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748453.810348:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f56c1729 reply state 000000005a556f3d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810362:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810370:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748453.810373:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748453.810378:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788748453.810385:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788748453.810394:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810401:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810409:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810416:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748453.810421:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810442:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810453:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc82598300) 00010000:00010000:2.0:1788748453.810456:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748453.810466:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810472:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a990 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748453.810490:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f56c1729 reply state 000000005a556f3d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810499:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.810505:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adc82598d00) 00010000:00010000:2.0:1788748453.810507:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748453.810509:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788748453.810621:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:12192:x1875638368673152:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 3923us (5064us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788748453.810631:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:2.0:1788748453.897536:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748453.897745:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368673280 00000100:00100000:0.0:1788748453.897758:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368673280 00000100:00100000:0.0:1788748453.897842:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:0.0:1788748453.897855:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+14:12200:x1875638368673280:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:0.0:1788748453.897887:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748453.897919:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a9a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d90 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.898008:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a9ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.898026:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.898042:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748453.898301:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788748453.898306:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748453.898387:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a9ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.898420:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1a9a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d90 expref: 16 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.898444:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a9ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d90 expref: 15 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.898479:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:0.0:1788748453.898482:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748453.898487:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148bc00, rc 0) 00000100:00100000:0.0:1788748453.898623:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:12200:x1875638368673280:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 770us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748453.898631:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:3.0:1788748453.953409:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748453.953497:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368673408 00000100:00100000:2.0:1788748453.953513:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368673408 00000100:00100000:2.0:1788748453.953605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 155 00000100:00100000:2.0:1788748453.953618:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add812ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+15:12206:x1875638368673408:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748453.953647:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748453.953676:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a9b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d97 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953776:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953799:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953848:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953862:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953870:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953877:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953977:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a9c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953986:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.953993:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748453.954053:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788748453.954067:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748453.954093:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954108:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954115:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954519:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954528:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748453.954532:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954601:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954618:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:2.0:1788748453.954622:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748453.954629:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954636:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954654:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954661:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954667:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954672:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748453.954675:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954693:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954703:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adc82598d00) 00010000:00010000:2.0:1788748453.954705:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748453.954708:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954714:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954761:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a9b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d97 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954779:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d97 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.954787:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748453.954789:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788748453.954792:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd400, rc 0) 00000100:00100000:2.0:1788748453.955309:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add812ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:12206:x1875638368673408:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1689us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748453.955375:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 155 00000100:00100000:1.0:1788748453.963140:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748453.963251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368673664 00000100:00100000:2.0:1788748453.963264:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368673664 00000100:00100000:2.0:1788748453.963378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:2.0:1788748453.963391:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+16:12206:x1875638368673664:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748453.963502:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748453.963530:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a9cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3d9e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.963820:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.963839:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.963854:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.963872:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.963879:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.963885:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788748453.968113:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788748453.968395:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968418:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968502:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968572:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968579:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968586:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968593:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748453.968598:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968606:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968621:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748453.968624:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748453.968702:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968711:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1a9d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748453.968740:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005754a006 reply state 00000000c6a9074f transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968754:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968761:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:2.0:1788748453.968770:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748453.968775:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788748453.968827:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1a9cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968846:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.968854:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adc82598600) 00010000:00010000:2.0:1788748453.968856:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748453.968859:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc000, rc 0) 00000100:00100000:2.0:1788748453.969087:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:12206:x1875638368673664:12345-192.168.203.22@tcp:101:bash.0 Request processed in 5698us (5961us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788748453.969098:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:0.0:1788748453.973289:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748453.973589:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368673792 00000100:00100000:2.0:1788748453.973602:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368673792 00000100:00100000:2.0:1788748453.973705:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1788748453.973718:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368673792:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748453.973752:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748453.973780:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3da5 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748453.973816:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748453.973845:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1788748453.973850:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748453.973863:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.973915:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.973933:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc200, rc 0) 00000100:00080000:3.0:1788748453.974344:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748453.974407:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368673792:12345-192.168.203.22@tcp:101:bash.0 Request processed in 690us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748453.974416:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788748453.978301:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748453.978589:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368673920 00000100:00100000:0.0:1788748453.978603:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368673920 00000100:00100000:0.0:1788748453.978778:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:0.0:1788748453.978791:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:12206:x1875638368673920:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748453.978816:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748453.978838:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3dac expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.978878:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.978888:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748453.978893:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748453.978898:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.978940:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748453.979113:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 7 pid: 8425 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748453.979130:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8424:1875638388659328:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748453.979289:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748453.983047:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748453.983354:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368674048 00000100:00100000:2.0:1788748453.983367:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368674048 00010000:00010000:2.0:1788748453.983420:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 8 pid: 8425 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748453.983484:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:2.0:1788748453.983495:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84940000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368674048:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748453.983515:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748453.983544:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 8 pid: 8425 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.983560:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 8 pid: 8425 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.983592:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748453.983598:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748453.983608:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.983815:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748453.983867:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 8 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748453.983885:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1875638388659456:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788748453.983996:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc841453c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788748453.986876:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000496ba4f2/0x9ba0f20a02e1a9f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3da5 expref: 8 pid: 8425 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748453.986910:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8424:1875638388659328:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748453.986961:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 7 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748453.986982:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a600, rc 0) 00000100:00100000:3.0:1788748453.987416:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:12206:x1875638368673920:12345-192.168.203.22@tcp:101:bash.0 Request processed in 8624us (9125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748453.987462:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1788748453.991394:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849bc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1875638388659456:192.168.203.22@tcp:105: 00010000:00010000:3.0:1788748453.991490:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748453.991778:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84940000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2410:x1875638368674048:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 8282us (8742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748453.991792:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:1.0:1788748453.992149:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748453.993345:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368674304 00000100:00100000:3.0:1788748453.993361:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368674304 00000100:00100000:3.0:1788748453.993546:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1788748453.993561:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:12206:x1875638368674304:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1788748453.994060:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:12206:x1875638368674304:12345-192.168.203.22@tcp:35:bash.0 Request processed in 500us (1909us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788748453.995816:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1788748454.094931:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.095004:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368674560 00000100:00100000:0.0:1788748454.095019:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368674560 00000100:00100000:0.0:1788748454.095094:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:0.0:1788748454.095107:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:12216:x1875638368674560:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748454.095140:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748454.095167:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1aa00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3db3 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748454.095311:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788748454.095676:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1aa00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3db3 expref: 22 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.095695:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:1.0:1788748454.095698:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748454.095705:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1aa00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3db3 expref: 22 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.095723:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148a400, rc 0) 00000100:00100000:1.0:1788748454.095950:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:12216:x1875638368674560:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 844us (1030us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788748454.095960:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:0.0:1788748454.100621:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748454.100706:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368674816 00000100:00100000:1.0:1788748454.100720:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368674816 00000100:00100000:1.0:1788748454.100804:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:1.0:1788748454.100816:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:12216:x1875638368674816:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748454.101137:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:12216:x1875638368674816:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 321us (528us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788748454.101146:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:2.0:1788748454.176263:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748454.176458:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368674944 00000100:00100000:1.0:1788748454.176471:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368674944 00000100:00100000:1.0:1788748454.176551:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:1.0:1788748454.176563:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:12222:x1875638368674944:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748454.176595:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748454.176631:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1aa0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3dba expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.176716:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1aa15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.176745:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1aa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.176762:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1aa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748454.176820:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788748454.176824:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748454.176848:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1aa15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.176881:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1aa0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dba expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.176901:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1aa15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dba expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.176910:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:1.0:1788748454.176914:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748454.176935:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68600, rc 0) 00000100:00100000:1.0:1788748454.177184:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:12222:x1875638368674944:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 451us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748454.177192:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:2.0:1788748454.191684:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.191815:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368675200 00000100:00100000:0.0:1788748454.191828:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368675200 00000100:00100000:0.0:1788748454.191905:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:0.0:1788748454.191918:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:12222:x1875638368675200:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748454.191943:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748454.191969:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1aa1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3dc1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.192248:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.192287:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.192307:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748454.192349:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788748454.192609:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1aa1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dc1 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.192632:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dc1 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.192641:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adc82598600) 00010000:00010000:0.0:1788748454.192645:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748454.192649:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:0.0:1788748454.192745:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:12222:x1875638368675200:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 829us (1075us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788748454.192753:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:2.0:1788748454.198610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.198704:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368675328 00000100:00100000:0.0:1788748454.198716:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368675328 00000100:00100000:0.0:1788748454.198808:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1788748454.198821:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:2413:x1875638368675328:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748454.198840:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748454.198872:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dc1 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.198920:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adc82598600) 00010000:00010000:0.0:1788748454.198928:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748454.199007:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:2413:x1875638368675328:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 188us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748454.199022:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1788748454.206903:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748454.207160:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368675584 00000100:00100000:1.0:1788748454.207173:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368675584 00000100:00100000:1.0:1788748454.207243:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:1.0:1788748454.207253:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:12222:x1875638368675584:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748454.207285:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748454.207309:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1aa31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3dc8 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.207470:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1aa38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.207486:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1aa38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.207511:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1aa38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748454.207526:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788748454.207666:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1aa31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dc8 expref: 27 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.207690:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1aa38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dc8 expref: 26 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.207700:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adc82598600) 00010000:00010000:1.0:1788748454.207721:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788748454.207726:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68000, rc 0) 00000100:00100000:1.0:1788748454.207813:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+26:12222:x1875638368675584:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 561us (924us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788748454.207821:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:2.0:1788748454.219039:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.219156:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368675712 00000100:00100000:0.0:1788748454.219168:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368675712 00000100:00100000:0.0:1788748454.219236:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1788748454.219248:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368675712:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:0.0:1788748454.219306:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.219384:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 6 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.219396:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788748454.219401:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748454.219405:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.219464:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 6 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.219481:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 6 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748454.219525:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84942680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875638388659584:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748454.219646:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748454.226988:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84942680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875638388659584:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748454.228296:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748454.230845:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.230951:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368675840 00000100:00100000:0.0:1788748454.230964:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368675840 00002000:00100000:0.0:1788748454.231038:0:8430:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8adc849bc380 x1875638368675840/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:200/0 lens 504/0 e 0 to 0 dl 1788748465 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748454.231051:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc849bc380 with x1875638368675840 ext(0->12) 00010000:00010000:0.0:1788748454.231064:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 7 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.231087:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 7 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748454.231096:0:8430:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc849bc380 00000100:00100000:0.0:1788748454.231238:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1788748454.231249:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368675840:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:0.0:1788748454.237612:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2410:x1875638368675840:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 6354us (6768us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788748454.238275:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:0.0:1788748454.238290:0:8430:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8adc849bc380 x1875638368675840/t4294967306(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:200/0 lens 504/448 e 0 to 0 dl 1788748465 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748454.238300:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc849bc380 with x1875638368675840 ext(0->12) 00010000:00010000:0.0:1788748454.238312:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 9 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.238864:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 9 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748454.238873:0:8430:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc849bc380 00000100:00100000:0.0:1788748454.245745:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.245856:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368675968 00000100:00100000:2.0:1788748454.245871:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368675968 00010000:00010000:2.0:1788748454.245925:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 9 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748454.245990:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1788748454.246000:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84942680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2411:x1875638368675968:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748454.246256:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788748454.246282:0:9515:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788748454.246285:0:9515:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788748454 00002000:00010000:2.0:1788748454.246287:0:9515:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788748455 00002000:00010000:2.0:1788748454.246309:0:9515:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788748454 00002000:00010000:2.0:1788748454.246311:0:9515:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788748454.246350:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 9 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.246368:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 9 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.246396:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040d4c781/0x9ba0f20a02e1a9f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dac expref: 9 pid: 8424 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.246416:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748454.246430:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748454.246438:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.246449:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.246479:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748454.247350:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.247368:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.247399:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.247409:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.247418:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.247540:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748454.247692:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84942680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368675968:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1686us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748454.247704:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00010000:00010000:0.0:1788748454.248409:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748454.248415:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.248426:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.248467:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.248475:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1aa46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748454.249378:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2412:x1875638368675712:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 30123us (30343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748454.249391:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1788748454.255418:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748454.255668:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368676224 00000100:00100000:1.0:1788748454.255682:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368676224 00000100:00100000:1.0:1788748454.255762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1788748454.255775:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda703b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+26:12222:x1875638368676224:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:1.0:1788748454.255859:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1aa38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dc8 expref: 26 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748454.256107:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788748454.256157:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788748454.256605:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788748454.256656:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.256675:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.256684:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.256761:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.256780:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 30 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748454.256798:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc81e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388659712:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748454.256926:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748454.262544:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748454.262988:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368676352 00000100:00100000:3.0:1788748454.263003:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368676352 00010000:00010000:3.0:1788748454.263074:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 31 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748454.263131:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:3.0:1788748454.263142:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+31:2410:x1875638368676352:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748454.263159:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748454.263167:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 31 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.263183:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 31 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.263230:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adc82598600) 00010000:00010000:3.0:1788748454.263237:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.263262:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.263272:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.263296:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748454.263402:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+31:2410:x1875638368676352:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 261us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748454.263410:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00010000:00010000:0.0:1788748454.266103:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1a9e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d9e expref: 30 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748454.266192:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc81e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388659712:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748454.266225:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.266236:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.266242:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748454.266871:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1788748454.267034:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788748454.267171:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388659840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748454.267377:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748454.267418:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748454.267674:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388659840 00000100:00100000:2.0:1788748454.267684:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388659840 00000100:00100000:2.0:1788748454.267772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788748454.267784:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388659840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788748454.267921:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc81e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388659840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748454.267928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788748454.268027:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388659840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748454.268179:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788748454.268240:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388659968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748454.268883:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748454.268910:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1788748454.269092:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748454.269267:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388659968 00000100:00100000:2.0:1788748454.269276:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388659968 00000100:00100000:2.0:1788748454.269357:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788748454.269369:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388659968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788748454.269899:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1875638388659968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 530us (1015us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788748454.269908:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788748454.270094:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388659968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748454.270179:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788748454.270231:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.270242:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.270251:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.270257:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748454.270262:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.270271:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.270290:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adc82598600) 00010000:00010000:0.0:1788748454.270293:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788748454.270299:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.270350:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1aa4d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748454.270744:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788748454.270825:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788748454.270839:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371257521917ns, next at 372257519076ns, rc = 0 00000001:00080000:0.0:1788748454.270847:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788748454.270875:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adc82598600) 00010000:00010000:0.0:1788748454.270878:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788748454.270887:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1aa38 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dc8 expref: 34 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748454.271257:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda703b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:12222:x1875638368676224:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 15482us (15850us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788748454.271269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000020:00080000:0.0:1788748454.271275:0:6514:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788748454.275208:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.275617:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368676480 00000100:00100000:0.0:1788748454.275630:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368676480 00000100:00100000:0.0:1788748454.275715:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:0.0:1788748454.275727:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+33:12222:x1875638368676480:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748454.275768:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748454.275801:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3dcf expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.275882:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dcf expref: 34 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.275928:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dcf expref: 34 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748454.275963:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748454.275967:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748454.275972:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:0.0:1788748454.276052:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:12222:x1875638368676480:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 326us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748454.276060:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:3.0:1788748454.279408:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.279743:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368676736 00000100:00100000:0.0:1788748454.279756:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368676736 00000100:00100000:0.0:1788748454.279827:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1788748454.279839:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:12222:x1875638368676736:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1788748454.280719:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:12222:x1875638368676736:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 875us (1316us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788748454.280740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1788748454.382595:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748454.382992:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368676992 00000100:00100000:3.0:1788748454.383015:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368676992 00000100:00100000:3.0:1788748454.383095:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:3.0:1788748454.383108:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:12232:x1875638368676992:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748454.383150:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748454.383174:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3dd6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748454.383313:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788748454.383524:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dd6 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.383565:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:3.0:1788748454.383568:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748454.383574:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dd6 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.383591:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bba200, rc 0) 00000100:00100000:3.0:1788748454.383670:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:12232:x1875638368676992:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 565us (1089us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788748454.383679:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:1.0:1788748454.389619:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748454.389784:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368677120 00000100:00100000:3.0:1788748454.389797:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368677120 00000100:00100000:3.0:1788748454.389869:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:3.0:1788748454.389882:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:12232:x1875638368677120:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1788748454.389996:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390019:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390034:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390045:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390053:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390086:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390208:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390217:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390225:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748454.390303:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390359:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390368:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390376:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390383:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748454.390389:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390398:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390413:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748454.390424:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748454.390431:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390438:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1aa69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390454:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390461:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390468:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390472:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748454.390475:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390482:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390489:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:3.0:1788748454.390492:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748454.390494:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390681:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1aa70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390696:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390709:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390715:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390720:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748454.390724:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390739:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390748:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748454.390750:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748454.390754:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.390760:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aa77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748454.390859:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:12232:x1875638368677120:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 976us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748454.390868:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:0.0:1788748454.395442:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.395637:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368677376 00000100:00100000:2.0:1788748454.395650:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368677376 00000100:00100000:2.0:1788748454.395725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1788748454.395746:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+36:12232:x1875638368677376:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748454.396068:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:12232:x1875638368677376:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 324us (651us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788748454.396076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1788748454.443906:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.444176:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368677632 00000100:00100000:2.0:1788748454.444190:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368677632 00000100:00100000:2.0:1788748454.444276:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:2.0:1788748454.444289:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:12235:x1875638368677632:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748454.444365:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748454.444391:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aa7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ddd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.444796:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.444834:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.444850:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.444865:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.444874:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.444881:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445349:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445362:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445371:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748454.445385:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788748454.445683:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445692:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445699:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445715:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748454.445720:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445727:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445750:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748454.445753:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748454.445760:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445766:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aa85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445782:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445787:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445792:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445797:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bcc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748454.445800:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445805:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445823:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:2.0:1788748454.445826:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748454.445829:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445835:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aa8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445890:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aa7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445906:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.445913:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748454.445916:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748454.445918:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd600, rc 0) 00000100:00100000:2.0:1788748454.446638:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:12235:x1875638368677632:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2344us (2737us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788748454.446649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:0.0:1788748454.455907:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748454.456204:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368677760 00000100:00100000:1.0:1788748454.456218:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368677760 00000100:00100000:1.0:1788748454.456931:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:1.0:1788748454.457584:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:12235:x1875638368677760:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1788748454.457690:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457713:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457738:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457788:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457816:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457824:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457831:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748454.457837:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457846:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457862:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:1.0:1788748454.457866:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748454.457874:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748454.457880:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1aaa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748454.458203:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:12235:x1875638368677760:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 1258us (2306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748454.458214:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:0.0:1788748454.461682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.461874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368678016 00000100:00100000:2.0:1788748454.461887:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368678016 00000100:00100000:2.0:1788748454.462002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1788748454.462023:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:12235:x1875638368678016:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748454.462399:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+40:12235:x1875638368678016:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 386us (729us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788748454.462407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1788748454.692786:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748454.702168:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388660096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748454.702286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748454.702805:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388660096 00000100:00100000:0.0:1788748454.702817:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388660096 00000100:00100000:0.0:1788748454.702877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788748454.702888:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388660096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748454.702950:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788748454.703015:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388660096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748454.703039:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788748454.708031:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388660096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748454.758662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.758844:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368678272 00000100:00100000:2.0:1788748454.758858:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368678272 00000100:00100000:2.0:1788748454.758928:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:2.0:1788748454.758938:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+40:12266:x1875638368678272:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1788748454.758972:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748454.759003:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aaa8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3de4 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.759221:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aaaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.759237:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aaaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.759250:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aaaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748454.759272:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788748454.759696:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aaa8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3de4 expref: 43 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.759723:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aaaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3de4 expref: 42 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.759742:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748454.759765:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748454.759770:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bcc00, rc 0) 00000100:00100000:2.0:1788748454.759845:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:12266:x1875638368678272:12345-192.168.203.22@tcp:101:cat.0 Request processed in 907us (1194us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788748454.759853:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:1.0:1788748454.764716:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748454.764849:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748454.764973:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368678656 00000100:00100000:0.0:1788748454.764987:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368678656 00000100:00100000:0.0:1788748454.765067:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1788748454.765079:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:12266:x1875638368678656:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:0.0:1788748454.766167:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:12266:x1875638368678656:12345-192.168.203.22@tcp:35:cat.0 Request processed in 1084us (1459us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788748454.766181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1788748454.766840:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368678400 00000100:00100000:3.0:1788748454.766851:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368678400 00000100:00100000:3.0:1788748454.766972:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1788748454.766984:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:2411:x1875638368678400:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748454.767002:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748454.767063:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1aaaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3de4 expref: 43 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.767087:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748454.767093:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748454.767145:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:2411:x1875638368678400:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 165us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748454.767153:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1788748454.820984:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.821192:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368678912 00000100:00100000:2.0:1788748454.821205:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368678912 00000100:00100000:2.0:1788748454.821511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:2.0:1788748454.821527:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:12272:x1875638368678912:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:2.0:1788748454.821561:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748454.821566:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788748454.821601:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1aa15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dba expref: 42 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.821624:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748454.821629:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748454.821644:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aabd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3deb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.821800:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.821816:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.821825:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.821865:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.821901:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 42 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748454.821918:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388660224:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748454.822050:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84145a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748454.826909:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.827037:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388660224:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748454.827075:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748454.827212:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368679040 00000100:00100000:3.0:1788748454.827222:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368679040 00010000:00010000:3.0:1788748454.827271:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 43 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748454.827476:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:3.0:1788748454.827489:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:2410:x1875638368679040:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748454.827522:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748454.827530:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 43 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.827546:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 43 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.827575:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aa93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ddd expref: 43 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.827595:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748454.827605:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.827633:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.827642:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.827672:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748454.827755:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:2410:x1875638368679040:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 267us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748454.827763:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00010000:00010000:2.0:1788748454.829670:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.829692:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748454.829722:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788748454.829927:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aabd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.835764:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.835790:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748454.835794:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748454.835798:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd000, rc 0) 00000100:00100000:2.0:1788748454.835995:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:12272:x1875638368678912:12345-192.168.203.22@tcp:101:dd.0 Request processed in 14469us (15023us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788748454.836039:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:1.0:1788748454.847464:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748454.847803:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368679168 00000100:00100000:2.0:1788748454.847817:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368679168 00000100:00100000:2.0:1788748454.847966:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:2.0:1788748454.847980:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:12272:x1875638368679168:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:2.0:1788748454.848023:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748454.848053:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aad2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3df2 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.848099:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.848127:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.848143:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.848306:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aad2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 44 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.848378:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 43 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748454.848388:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748454.848391:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748454.848396:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc200, rc 0) 00000100:00100000:2.0:1788748454.848474:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:12272:x1875638368679168:12345-192.168.203.22@tcp:101:dd.0 Request processed in 497us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748454.848488:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:1.0:1788748454.853018:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748454.853355:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368679424 00000100:00100000:3.0:1788748454.853369:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368679424 00000100:00100000:3.0:1788748454.853432:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:3.0:1788748454.853446:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:12272:x1875638368679424:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:3.0:1788748454.856789:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.856822:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.856838:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788748454.856900:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1788748454.856932:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008da076ed reply state 000000005085349b transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.857097:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748454.857196:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748454.857199:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748454.857205:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748454.857605:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+46:12272:x1875638368679424:12345-192.168.203.22@tcp:36:dd.0 Request processed in 4156us (4605us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788748454.857615:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00000020:00080000:3.0:1788748454.857623:0:6510:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788748455.077978:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748455.078019:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748455.078635:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788748455.078665:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748455.116247:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748455.116463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368679552 00000100:00100000:2.0:1788748455.116476:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368679552 00000100:00100000:2.0:1788748455.116570:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:2.0:1788748455.116583:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+46:12286:x1875638368679552:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:2.0:1788748455.116614:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748455.116642:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aae7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3df9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116736:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116755:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116772:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116789:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116797:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116803:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116894:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116930:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116939:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116979:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.116997:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 47 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748455.117014:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388660352:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748455.117140:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84145a80 going to sleep for 11 seconds 00000100:00080000:3.0:1788748455.117406:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748455.121348:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.121699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368679808 00000100:00100000:0.0:1788748455.121712:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368679808 00000100:00100000:0.0:1788748455.121793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788748455.121806:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+48:6181:x1875638368679808:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788748455.122297:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:6181:x1875638368679808:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 491us (986us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788748455.122307:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1788748455.123625:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388660352:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748455.123660:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748455.127710:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748455.127824:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368679936 00000100:00100000:2.0:1788748455.127837:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368679936 00010000:00010000:2.0:1788748455.127895:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 49 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748455.128083:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:2.0:1788748455.128096:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:2411:x1875638368679936:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748455.128125:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748455.128150:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 49 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.128167:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 49 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.128196:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aac4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3deb expref: 49 pid: 6512 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.128217:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748455.128224:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.128235:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.128244:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.128613:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748455.128687:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+48:2411:x1875638368679936:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 592us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748455.128695:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00010000:00010000:3.0:1788748455.130549:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130568:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748455.130653:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788748455.130659:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748455.130689:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130721:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130739:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130748:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130754:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748455.130780:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130789:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130808:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748455.130812:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748455.130817:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130824:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1aaee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130842:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130849:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130854:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130859:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748455.130862:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130867:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130875:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:3.0:1788748455.130877:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748455.130887:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.130893:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1aaf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.131071:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1aae7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df9 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.131093:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df9 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.131101:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748455.131103:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748455.131106:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd600, rc 0) 00000100:00100000:3.0:1788748455.131525:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+47:12286:x1875638368679552:12345-192.168.203.22@tcp:101:stat.0 Request processed in 14942us (15289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748455.131535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:1.0:1788748455.202662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.204750:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388660480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748455.204842:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.205197:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388660480 00000100:00100000:1.0:1788748455.205208:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388660480 00000100:00100000:1.0:1788748455.205300:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788748455.205312:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388660480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748455.205366:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748455.205652:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388660480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 341us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748455.205660:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788748455.205734:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388660480:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788748455.205821:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748455.205876:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748455.205887:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbf4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388660608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748455.205935:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748455.205964:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388660992:0@lo:400:kworker.0 00000100:00100000:3.0:1788748455.206018:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748455.206055:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388660608 00000100:00100000:3.0:1788748455.206060:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388660608 00000100:00100000:3.0:1788748455.206089:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788748455.206100:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388660608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748455.206115:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748455.206172:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388660608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748455.206179:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788748455.206270:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388660992 00000100:00100000:3.0:1788748455.206274:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388660992 00000100:00100000:3.0:1788748455.206301:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788748455.206307:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388660992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.206342:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388660736:0@lo:400:kworker.0 00000100:00100000:3.0:1788748455.206368:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388660992:12345-0@lo:400:kworker.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748455.206376:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788748455.206389:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748455.206400:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388661504:0@lo:400:kworker.0 00000100:00100000:3.0:1788748455.206429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748455.206526:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbc83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388660864:0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.206595:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388661248:0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.206623:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.206645:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388661760:0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.206669:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.206704:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388660736 00000100:00100000:1.0:1788748455.206708:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388660736 00000100:00100000:1.0:1788748455.206749:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788748455.206756:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388660736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.206803:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388660736:12345-0@lo:400:kworker.0 Request processed in 48us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748455.206811:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788748455.206845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388661248 00000100:00100000:1.0:1788748455.206849:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388661248 00000100:00100000:1.0:1788748455.206875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788748455.206881:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388661248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.206912:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388661248:12345-0@lo:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748455.206917:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788748455.206953:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388661120:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.207272:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388660736:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.207299:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388661248:0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.207551:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388661760 00000100:00100000:1.0:1788748455.207557:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388661760 00000100:00100000:1.0:1788748455.207604:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788748455.207612:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388661760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.207666:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388661760:12345-0@lo:400:kworker.0 Request processed in 55us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748455.207672:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788748455.207761:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748455.207784:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788748455.207790:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc84950e00, transno 4294967313 00000100:00100000:0.0:1788748455.207808:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388661760:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.211197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.211311:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388662016:0@lo:400:kworker.0 00000100:00100000:2.0:1788748455.211336:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368680192 00000100:00100000:2.0:1788748455.211348:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368680192 00000100:00100000:2.0:1788748455.211422:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388661504 00000100:00100000:2.0:1788748455.211426:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388661504 00000100:00080000:2.0:1788748455.211452:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748455.211836:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788748455.211848:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388661504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748455.211967:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388661504:12345-0@lo:400:kworker.0 Request processed in 121us (5535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748455.211976:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788748455.212000:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:2.0:1788748455.212008:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+47:12292:x1875638368680192:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:2.0:1788748455.212085:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748455.212120:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1aafc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df9 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.212142:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748455.212148:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748455.212434:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.212452:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.212464:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748455.212514:0:8447:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788748455.212540:0:8447:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001aa3f733 reply state 000000001ba1d518 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.212553:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.213023:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748455.213029:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748455.213044:0:8447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748455.214148:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:12292:x1875638368680192:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 1167us (10527us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788748455.214162:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 171 00000020:00080000:2.0:1788748455.214169:0:8447:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788748455.214532:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388661376:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.214591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.214607:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748455.214610:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388661888:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.214633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.214647:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388661632:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.214670:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388660864 00000100:00100000:0.0:1788748455.214680:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388660864 00000100:00100000:1.0:1788748455.214687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748455.214720:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788748455.214732:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388661376 00000100:00100000:1.0:1788748455.214736:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388661376 00000100:00100000:0.0:1788748455.214739:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388660864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.214765:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388661120 00000100:00100000:1.0:1788748455.214767:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388661120 00000100:00100000:1.0:1788748455.214778:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388661888 00000100:00100000:1.0:1788748455.214781:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388661888 00000100:00100000:0.0:1788748455.214798:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875638388660864:12345-0@lo:400:kworker.0 Request processed in 62us (3612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748455.214805:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788748455.214816:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788748455.214821:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388661376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.214870:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388661376:12345-0@lo:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748455.214971:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388661632 00000100:00100000:2.0:1788748455.214976:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388661632 00000100:00100000:2.0:1788748455.215013:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788748455.215021:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388661632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748455.215067:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388661632:12345-0@lo:400:kworker.0 Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748455.215075:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788748455.215093:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748455.215098:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748455.215109:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748455.215154:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388660992:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.215591:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788748455.215601:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388661120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.215645:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388661120:12345-0@lo:400:kworker.0 Request processed in 46us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748455.215649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388662016 00000100:00100000:0.0:1788748455.215653:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788748455.215657:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388662016 00000100:00100000:0.0:1788748455.215676:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788748455.215684:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388661888:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788748455.215693:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748455.215733:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788748455.215744:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388662016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.215747:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875638388661888:12345-0@lo:400:kworker.0 Request processed in 63us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748455.215757:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788748455.215796:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388662016:12345-0@lo:400:kworker.0 Request processed in 53us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748455.215796:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbc83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875638388660864:0@lo:400:kworker.0 00000100:00100000:3.0:1788748455.215810:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788748455.215818:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388661376:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.215830:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875638388661888:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.215892:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388661120:0@lo:400:kworker.0 00000100:00100000:0.0:1788748455.215905:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388661632:0@lo:400:kworker.0 00000100:00100000:2.0:1788748455.218275:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbf4c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388660608:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788748455.218387:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84939f80 x1875638388661504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748455.218399:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388661504:0@lo:400:kworker.0 00010000:00080000:2.0:1788748455.218416:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc8493a300 x1875638388662016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748455.218425:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388662016:0@lo:400:kworker.0 00000100:00100000:1.0:1788748455.220101:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00010000:2.0:1788748455.268614:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748455.269212:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788748455.485118:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.485227:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368680320 00000100:00100000:0.0:1788748455.485240:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368680320 00000100:00100000:0.0:1788748455.485390:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:0.0:1788748455.485404:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+49:12306:x1875638368680320:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:0.0:1788748455.485436:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748455.485465:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1ab0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e00 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.485553:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.485571:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.485588:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.485911:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.485936:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.485945:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486045:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486056:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486064:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748455.486310:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788748455.486414:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748455.486445:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486459:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486470:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486477:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486484:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486504:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748455.486509:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486518:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486533:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748455.486537:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748455.486544:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486551:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a600/0x9ba0f20a02e1ab11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486567:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486574:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486581:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486586:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748455.486589:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486772:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486790:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:0.0:1788748455.486793:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748455.486797:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486803:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a800/0x9ba0f20a02e1ab18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486842:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148a400/0x9ba0f20a02e1ab0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 51 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486859:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 50 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.486866:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748455.486869:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748455.486871:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940a00, rc 0) 00000100:00100000:0.0:1788748455.487033:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+50:12306:x1875638368680320:12345-192.168.203.22@tcp:101:stat.0 Request processed in 1631us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748455.487042:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:1.0:1788748455.580453:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748455.580620:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368680576 00000100:00100000:3.0:1788748455.580633:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368680576 00000100:00100000:3.0:1788748455.580737:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:3.0:1788748455.580750:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+50:12316:x1875638368680576:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748455.580778:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748455.580806:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e07 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748455.580971:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788748455.581102:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e07 expref: 52 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.581119:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:3.0:1788748455.581122:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748455.581128:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e07 expref: 52 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.581146:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb000, rc 0) 00000100:00100000:3.0:1788748455.581776:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+51:12316:x1875638368680576:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1026us (1333us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788748455.581787:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:1.0:1788748455.591180:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.595657:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368680832 00000100:00100000:0.0:1788748455.597907:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368680832 00000100:00100000:0.0:1788748455.598036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1788748455.598050:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda703bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+51:12316:x1875638368680832:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1788748455.598391:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda703bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+52:12316:x1875638368680832:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 343us (7221us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788748455.598400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1788748455.695475:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748455.696566:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368681088 00000100:00100000:2.0:1788748455.696583:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368681088 00000100:00100000:2.0:1788748455.696698:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:2.0:1788748455.696711:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+52:12322:x1875638368681088:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748455.696753:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748455.696782:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ab34 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e0e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.696930:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.696959:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 53 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.696969:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.697012:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 53 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.697028:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 53 pid: 10244 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748455.697043:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388662144:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748455.697173:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84145a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748455.700367:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748455.701767:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368681216 00000100:00100000:3.0:1788748455.701784:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368681216 00010000:00010000:3.0:1788748455.701852:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 54 pid: 10244 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748455.701914:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:3.0:1788748455.701926:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:2410:x1875638368681216:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748455.701956:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748455.701964:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 54 pid: 10244 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.701981:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 54 pid: 10244 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.702030:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748455.702037:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.702048:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.702058:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.702082:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748455.702160:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:2410:x1875638368681216:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 236us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748455.702169:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00010000:00010000:2.0:1788748455.705908:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ab1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e00 expref: 53 pid: 10244 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748455.705943:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388662144:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748455.705973:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.706007:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.706014:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748455.706043:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788748455.706216:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ab34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 54 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.706233:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 53 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.706243:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748455.706246:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748455.706251:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bcc00, rc 0) 00000100:00100000:2.0:1788748455.706414:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:12322:x1875638368681088:12345-192.168.203.22@tcp:101:bash.0 Request processed in 9705us (10951us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788748455.706424:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:0.0:1788748455.716784:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388662272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748455.716878:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.716992:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388662272 00000100:00100000:1.0:1788748455.717003:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388662272 00000100:00100000:1.0:1788748455.717071:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788748455.717082:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388662272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748455.717121:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788748455.717186:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388662272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748455.717193:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788748455.717285:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388662272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748455.722287:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.722533:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388662400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748455.722595:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748455.722694:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388662400 00000100:00100000:1.0:1788748455.722705:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388662400 00000100:00100000:1.0:1788748455.722778:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788748455.722789:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388662400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748455.722818:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788748455.722883:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388662400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748455.722890:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788748455.723069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368681472 00000100:00100000:3.0:1788748455.723074:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368681472 00000100:00100000:3.0:1788748455.723121:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:3.0:1788748455.723129:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+53:12322:x1875638368681472:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:3.0:1788748455.723453:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.723476:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.723490:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788748455.723541:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1788748455.723564:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005a862889 reply state 00000000e751e21e transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.723596:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.723603:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748455.723606:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748455.723610:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748455.723614:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388662400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748455.723705:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12322:x1875638368681472:12345-192.168.203.22@tcp:36:bash.0 Request processed in 576us (1432us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788748455.723711:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 175 00000020:00080000:3.0:1788748455.723716:0:6512:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788748455.752061:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748455.752188:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368681600 00000100:00100000:3.0:1788748455.752201:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368681600 00000100:00100000:3.0:1788748455.752275:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:3.0:1788748455.752288:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12322:x1875638368681600:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788748455.752361:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748455.752388:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1ab50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e15 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.752962:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.752984:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 57 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.752994:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.753038:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 57 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.753056:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 57 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748455.753072:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875638388662528:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748455.753208:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748455.761224:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748455.761471:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368681728 00000100:00100000:3.0:1788748455.761484:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368681728 00010000:00010000:3.0:1788748455.761539:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 58 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748455.761593:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1788748455.761604:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:2410:x1875638368681728:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748455.761621:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748455.761628:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 58 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.761665:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 58 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.761705:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748455.761711:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.761733:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.761742:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.761775:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748455.761844:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:2410:x1875638368681728:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 241us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748455.761853:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00010000:00010000:0.0:1788748455.762834:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ab3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e0e expref: 57 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748455.762860:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875638388662528:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748455.762901:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.762910:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.762915:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748455.762982:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788748455.762987:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748455.763015:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.763054:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1ab50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e15 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.763070:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e15 expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.763079:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748455.763081:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748455.763084:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941a00, rc 0) 00000100:00100000:0.0:1788748455.763149:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12322:x1875638368681600:12345-192.168.203.22@tcp:101:bash.0 Request processed in 10864us (11101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748455.763157:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:1.0:1788748455.766350:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.766407:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368681984 00000100:00100000:0.0:1788748455.766422:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368681984 00000100:00100000:0.0:1788748455.766625:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1788748455.766647:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12322:x1875638368681984:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1788748455.767791:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:12322:x1875638368681984:12345-192.168.203.22@tcp:35:bash.0 Request processed in 1150us (1471us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788748455.767806:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1788748455.859032:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748455.859916:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368682240 00000100:00100000:2.0:1788748455.859928:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368682240 00000100:00100000:2.0:1788748455.859998:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:2.0:1788748455.860008:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+57:12332:x1875638368682240:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748455.860031:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748455.860050:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ab5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748455.860162:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788748455.860658:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ab5e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e1c expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.860674:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:2.0:1788748455.860676:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748455.860681:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ab5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e1c expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.860695:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd600, rc 0) 00000100:00100000:2.0:1788748455.860815:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12332:x1875638368682240:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 807us (1792us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1788748455.860831:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:1.0:1788748455.878402:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.878524:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368682368 00000100:00100000:0.0:1788748455.878534:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368682368 00000100:00100000:0.0:1788748455.878597:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:0.0:1788748455.878606:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12332:x1875638368682368:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1788748455.878680:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878696:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878707:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878717:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878734:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878740:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878808:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878817:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878842:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788748455.878893:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878906:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878912:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878919:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878925:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748455.878930:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878937:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878947:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748455.878950:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748455.878955:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878961:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878973:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878986:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878992:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.878997:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748455.879000:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879007:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879016:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:0.0:1788748455.879018:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748455.879021:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879027:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879036:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879042:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879047:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879051:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748455.879060:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879066:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879074:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748455.879076:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748455.879078:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.879084:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748455.879166:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12332:x1875638368682368:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 560us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748455.879537:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:1.0:1788748455.886641:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748455.886804:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368682624 00000100:00100000:3.0:1788748455.886814:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368682624 00000100:00100000:3.0:1788748455.886872:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788748455.886882:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12332:x1875638368682624:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788748455.887140:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:12332:x1875638368682624:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 259us (509us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788748455.887149:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1788748455.949789:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748455.949869:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368682880 00000100:00100000:0.0:1788748455.949878:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368682880 00000100:00100000:0.0:1788748455.949936:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:0.0:1788748455.949947:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:12335:x1875638368682880:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748455.949972:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748455.949992:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e23 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950062:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950077:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950107:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950118:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950126:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950132:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950471:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ab96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950482:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950637:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ab96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748455.950649:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788748455.950741:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950748:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950755:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950761:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748455.950773:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950781:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950793:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748455.950796:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748455.950801:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950807:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1ab88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950821:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950826:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950832:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950837:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748455.950840:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950846:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950853:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:0.0:1788748455.950856:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748455.950864:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950870:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ab8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950909:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ab81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e23 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950922:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ab96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e23 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748455.950929:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748455.950931:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748455.950934:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941200, rc 0) 00000100:00100000:0.0:1788748455.950999:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:12335:x1875638368682880:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1053us (1219us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788748455.951007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:1.0:1788748455.960134:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748455.960187:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748455.960313:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368683136 00000100:00100000:2.0:1788748455.960358:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368683136 00000100:00100000:2.0:1788748455.960444:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:2.0:1788748455.960458:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:12335:x1875638368683136:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1788748455.960553:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960577:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960593:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960660:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960668:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960676:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960683:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748455.960688:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960696:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960710:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748455.960713:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748455.960727:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748455.960734:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1aba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748455.960826:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:12335:x1875638368683136:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 370us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748455.960834:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:3.0:1788748455.963679:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368683008 00000100:00100000:3.0:1788748455.963699:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368683008 00000100:00100000:3.0:1788748455.963875:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788748455.963905:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:2410:x1875638368683008:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748455.963928:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748455.963960:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ab96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e23 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748455.963985:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748455.963990:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748455.964075:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:2410:x1875638368683008:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 173us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748455.964083:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1788748455.974922:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748455.975004:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368683392 00000100:00100000:3.0:1788748455.975018:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368683392 00000100:00100000:3.0:1788748455.975089:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1788748455.975102:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:12335:x1875638368683392:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788748455.975450:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:12335:x1875638368683392:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 349us (540us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788748455.975458:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1788748456.122682:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.127161:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368683648 00000100:00100000:0.0:1788748456.127182:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368683648 00000100:00100000:0.0:1788748456.127394:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:0.0:1788748456.127407:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:12353:x1875638368683648:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1788748456.127440:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748456.127467:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1abab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e2a expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.127604:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abb2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.127646:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.127662:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748456.127677:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788748456.127936:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1abab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e2a expref: 64 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.127959:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abb2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e2a expref: 63 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.128122:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748456.128126:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788748456.128130:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748456.128380:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12353:x1875638368683648:12345-192.168.203.22@tcp:101:cat.0 Request processed in 975us (5710us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788748456.128389:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:1.0:1788748456.164159:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748456.164360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368683776 00000100:00100000:2.0:1788748456.164374:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368683776 00000100:00100000:2.0:1788748456.164470:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1788748456.164492:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12354:x1875638368683776:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748456.164529:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748456.164558:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e31 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.164647:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1abc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.164666:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1abc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.164679:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1abc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748456.164754:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788748456.164758:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748456.164782:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1abc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.164814:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e31 expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.164837:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1abc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e31 expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.164845:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748456.164848:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748456.164852:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc800, rc 0) 00000100:00100000:2.0:1788748456.164932:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12354:x1875638368683776:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 444us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748456.164950:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:1.0:1788748456.173456:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748456.173600:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368684160 00000100:00100000:3.0:1788748456.173612:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368684160 00000100:00100000:3.0:1788748456.173685:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:3.0:1788748456.173698:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12354:x1875638368684160:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788748456.174106:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12354:x1875638368684160:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 409us (661us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788748456.174115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1788748456.177270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748456.186357:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368684288 00000100:00100000:2.0:1788748456.186381:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368684288 00000100:00100000:2.0:1788748456.186501:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:2.0:1788748456.186514:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12354:x1875638368684288:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:2.0:1788748456.186536:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788748456.186570:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ab57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e15 expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.186600:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e2a expref: 64 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.186613:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1aa54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3dcf expref: 63 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.186625:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748456.186631:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748456.186725:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:12354:x1875638368684288:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 206us (9461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748456.186734:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1788748456.191946:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748456.192072:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368684416 00000100:00100000:2.0:1788748456.192086:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368684416 00000100:00100000:2.0:1788748456.192163:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:2.0:1788748456.192176:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:12354:x1875638368684416:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:2.0:1788748456.192392:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.192436:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748456.192451:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748456.192580:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788748456.192680:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:12354:x1875638368684416:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 506us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748456.192689:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:1.0:1788748456.244811:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.244909:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368684544 00000100:00100000:0.0:1788748456.244922:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368684544 00000100:00100000:0.0:1788748456.245002:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:0.0:1788748456.245014:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:12356:x1875638368684544:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748456.245040:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748456.245066:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1abd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e38 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245190:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245209:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245223:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245235:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245243:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245250:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245377:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245388:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245395:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748456.245621:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788748456.245627:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748456.245650:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245675:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245685:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245692:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245699:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245706:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748456.245711:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245727:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245741:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748456.245744:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748456.245750:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245755:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1abdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245769:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245774:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245787:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245793:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748456.245796:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245802:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245810:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:0.0:1788748456.245812:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748456.245815:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245821:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1abe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245852:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1abd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 64 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245865:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 63 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748456.245872:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748456.245874:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748456.245877:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748456.245944:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12356:x1875638368684544:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 932us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748456.245960:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 184 00010000:00010000:2.0:1788748456.293608:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748456.758234:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.758276:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.758308:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.758358:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.758376:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.758396:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.758421:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748456.758451:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368684928 00000100:00100000:0.0:1788748456.758463:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368684928 00000100:00100000:0.0:1788748456.758555:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368685440 00000100:00100000:0.0:1788748456.758559:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368685440 00000100:00100000:0.0:1788748456.758576:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368684800 00000100:00100000:0.0:1788748456.758578:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368684800 00000100:00100000:0.0:1788748456.758591:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368685312 00000100:00100000:0.0:1788748456.758593:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368685312 00000100:00100000:0.0:1788748456.758612:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:0.0:1788748456.758622:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368684928:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748456.758725:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2413:x1875638368684928:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 94us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748456.758742:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:0.0:1788748456.758764:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 306 00000100:00100000:0.0:1788748456.758770:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368685440:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748456.758799:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368685440:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748456.758805:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 306 00000100:00100000:0.0:1788748456.758834:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 307 00000100:00100000:0.0:1788748456.758840:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:2413:x1875638368684800:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748456.758870:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbc83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:2413:x1875638368684800:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748456.758876:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 307 00000100:00100000:0.0:1788748456.758887:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 308 00000100:00100000:0.0:1788748456.758893:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368685312:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748456.758937:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2413:x1875638368685312:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 43us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748456.758944:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 308 00000100:00100000:0.0:1788748456.758971:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368685184 00000100:00100000:0.0:1788748456.758976:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368685184 00000100:00100000:0.0:1788748456.759003:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368685056 00000100:00100000:0.0:1788748456.759006:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368685056 00000100:00100000:0.0:1788748456.759212:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:0.0:1788748456.759221:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2413:x1875638368685184:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748456.759250:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2413:x1875638368685184:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748456.759257:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:0.0:1788748456.759270:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1788748456.759276:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368685056:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748456.759301:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2413:x1875638368685056:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748456.759308:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00080000:0.0:1788748456.759356:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788748456.759361:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748456.759364:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788748456.759366:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748456.760168:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368684672 00000100:00100000:2.0:1788748456.760178:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368684672 00000100:00100000:2.0:1788748456.760227:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 386 00000100:00100000:2.0:1788748456.760235:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368684672:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748456.760281:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2413:x1875638368684672:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 47us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748456.760288:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 386 00000040:00080000:2.0:1788748457.125646:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748457.125659:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748457.125707:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788748457.125737:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748457.125973:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849bdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388662656:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748457.126094:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748457.135226:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.135252:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849bdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388662656:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788748457.141907:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368685568 00000100:00100000:0.0:1788748457.141930:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368685568 00000100:00100000:0.0:1788748457.142055:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:0.0:1788748457.142071:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12367:x1875638368685568:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788748457.142115:0:8447:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788748457.142263:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12367:x1875638368685568:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 198us (7049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748457.142272:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00080000:3.0:1788748457.144023:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748457.153181:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.153683:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368685696 00000100:00100000:3.0:1788748457.153699:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368685696 00000100:00100000:3.0:1788748457.153892:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:3.0:1788748457.153905:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12367:x1875638368685696:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788748457.154015:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.154035:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.154050:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156333:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156358:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156372:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156412:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156423:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156431:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748457.156507:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788748457.156512:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748457.156526:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156540:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156548:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156556:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156562:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748457.156567:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156575:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156587:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:3.0:1788748457.156590:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748457.156607:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156614:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba200/0x9ba0f20a02e1abf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.156630:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157510:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157518:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157524:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbac00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748457.157528:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157535:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157545:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8add864c2e00) 00010000:00010000:3.0:1788748457.157548:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748457.157551:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157558:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbac00/0x9ba0f20a02e1abf8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157578:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157585:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157591:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157958:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748457.157970:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157977:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.157988:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748457.157991:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748457.157994:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.158000:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1abff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748457.158117:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12367:x1875638368685696:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 4210us (4945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.158128:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:0.0:1788748457.166103:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.166201:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368685952 00000100:00100000:2.0:1788748457.166243:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368685952 00000100:00100000:2.0:1788748457.166364:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:2.0:1788748457.166377:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12367:x1875638368685952:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748457.166405:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748457.166431:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1ac06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e3f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166563:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166582:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166595:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748457.166609:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788748457.166705:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166726:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166732:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166738:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748457.166743:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166751:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166771:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748457.166775:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748457.166780:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166788:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166832:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1ac06 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e3f expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166843:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:2.0:1788748457.166845:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748457.166849:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bde00/0x9ba0f20a02e1ac06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e3f expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.166858:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bde00, rc 0) 00000100:00100000:2.0:1788748457.166935:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12367:x1875638368685952:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 562us (843us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788748457.166943:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:2.0:1788748457.170979:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.172436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368686080 00000100:00100000:3.0:1788748457.172451:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368686080 00000100:00100000:3.0:1788748457.172527:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:3.0:1788748457.172537:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12367:x1875638368686080:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788748457.172574:0:6511:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788748457.172743:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12367:x1875638368686080:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 207us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.172751:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:3.0:1788748457.175525:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748457.177037:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368686336 00000100:00100000:0.0:1788748457.177057:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368686336 00000100:00100000:0.0:1788748457.177150:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:0.0:1788748457.177162:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12367:x1875638368686336:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748457.177190:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748457.177194:0:10244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788748457.177229:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1abc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e31 expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.177255:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748457.177261:0:10244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748457.177279:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ac1b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e46 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748457.178967:0:10244:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788748457.179208:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ac22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.179228:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.179242:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.179347:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ac1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e46 expref: 66 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.179372:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ac22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e46 expref: 65 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.179381:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adda17e1600) 00010000:00010000:0.0:1788748457.179384:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748457.179388:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941200, rc 0) 00000100:00100000:0.0:1788748457.179479:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12367:x1875638368686336:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2318us (3962us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788748457.179490:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:1.0:1788748457.189469:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748457.189522:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368686592 00000100:00100000:1.0:1788748457.189535:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368686592 00000100:00100000:1.0:1788748457.189602:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:1.0:1788748457.189612:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12367:x1875638368686592:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788748457.189684:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748457.189730:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ac22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e46 expref: 65 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.189752:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adda17e1600) 00010000:00010000:1.0:1788748457.189764:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748457.189792:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.189814:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.189828:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.193841:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.193864:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.193879:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.193935:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.193943:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.193950:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.193957:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748457.193961:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194113:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194128:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:1.0:1788748457.194143:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748457.194195:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194203:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1ac30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194217:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194223:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194230:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194235:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748457.194238:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194244:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194252:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x52383dbe (ffff8addb5115100) 00010000:00010000:1.0:1788748457.194254:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748457.194258:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.194264:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ac37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x52383dbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748457.194555:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12367:x1875638368686592:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 4938us (5095us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788748457.194572:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:2.0:1788748457.201197:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.201253:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368686720 00000100:00100000:2.0:1788748457.201265:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368686720 00000100:00100000:2.0:1788748457.201539:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:2.0:1788748457.201565:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12367:x1875638368686720:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748457.201594:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748457.201639:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.201688:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.201706:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.201731:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.202950:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.202981:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.202990:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:2.0:1788748457.202993:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748457.202997:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd200, rc 0) 00000100:00100000:2.0:1788748457.203090:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12367:x1875638368686720:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1540us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748457.203100:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 191 00000040:00080000:0.0:1788748457.203453:0:14647:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748457.203459:0:14647:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748457.203503:0:14647:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788748457.203510:0:14647:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788748457.224116:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.224179:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368686976 00000100:00100000:2.0:1788748457.224195:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368686976 00000100:00100000:2.0:1788748457.224302:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:2.0:1788748457.224338:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12367:x1875638368686976:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748457.224456:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.224490:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.224506:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748457.224817:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788748457.224830:0:8447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374211512378ns, next at 375211509376ns, rc = 0 00000004:00010000:2.0:1788748457.224893:0:8447:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002b7a69c9 reply state 00000000d5569cb6 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.224909:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.224918:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:2.0:1788748457.224921:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788748457.224926:0:8447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748457.225632:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12367:x1875638368686976:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1243us (1450us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788748457.225644:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:1.0:1788748457.232591:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.232682:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368687104 00000100:00100000:2.0:1788748457.232699:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368687104 00000100:00100000:2.0:1788748457.232798:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:2.0:1788748457.232813:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12367:x1875638368687104:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748457.232854:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748457.232879:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e54 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.232986:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.233004:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.233026:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:2.0:1788748457.233030:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748457.233474:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc800, rc 0) 00000100:00100000:2.0:1788748457.233699:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:12367:x1875638368687104:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 887us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748457.233707:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:2.0:1788748457.242976:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748457.243070:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368687232 00000100:00100000:1.0:1788748457.243080:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368687232 00000100:00100000:1.0:1788748457.243140:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788748457.243150:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368687232:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788748457.243419:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368687232:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 269us (451us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788748457.243427:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:3.0:1788748457.248985:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748457.249308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368687488 00000100:00100000:0.0:1788748457.249349:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368687488 00000100:00100000:0.0:1788748457.249426:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:0.0:1788748457.249439:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:12367:x1875638368687488:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788748457.249778:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+69:12367:x1875638368687488:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 340us (801us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788748457.249787:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1788748457.260785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.264110:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368687744 00000100:00100000:2.0:1788748457.264125:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368687744 00000100:00100000:2.0:1788748457.264198:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:2.0:1788748457.264209:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+69:12367:x1875638368687744:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788748457.264414:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+69:12367:x1875638368687744:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 206us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748457.264423:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:1.0:1788748457.274362:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.274449:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368687872 00000100:00100000:3.0:1788748457.274468:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368687872 00000100:00100000:3.0:1788748457.274552:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:3.0:1788748457.274564:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+69:12367:x1875638368687872:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748457.274592:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748457.274618:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1ac5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e5b expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.274704:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.274734:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.274747:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748457.274809:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748457.274833:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.274865:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1ac5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e5b expref: 71 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.274888:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e5b expref: 70 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.274897:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:3.0:1788748457.274900:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788748457.274904:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77800, rc 0) 00000100:00100000:3.0:1788748457.274982:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+70:12367:x1875638368687872:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 420us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.275001:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:0.0:1788748457.280401:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.280690:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368688000 00000100:00100000:3.0:1788748457.280704:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368688000 00000100:00100000:3.0:1788748457.280845:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1788748457.280860:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368688000:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748457.280879:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748457.280900:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e62 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748457.280926:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e22aa, blocks: 0x0 00010000:00010000:3.0:1788748457.280948:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1788748457.280953:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748457.280962:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.280982:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.281058:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77400, rc 0) 00000100:00100000:3.0:1788748457.281130:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368688000:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 273us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.281137:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1788748457.285047:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.287051:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368688256 00000100:00100000:3.0:1788748457.287064:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368688256 00000100:00100000:3.0:1788748457.287130:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:3.0:1788748457.287141:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda73a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+70:12367:x1875638368688256:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748457.288101:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda73a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+70:12367:x1875638368688256:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 955us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.288111:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:0.0:1788748457.296307:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.296414:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368688384 00000100:00100000:3.0:1788748457.296428:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368688384 00000100:00100000:3.0:1788748457.296486:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1788748457.296496:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:12367:x1875638368688384:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748457.296515:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748457.296534:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e69 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.296567:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.296577:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748457.296581:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748457.296587:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.296626:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.296641:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748457.296654:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1875638388662784:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748457.296766:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b210c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748457.304896:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.305064:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1875638388662784:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748457.305097:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.305117:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77e00, rc 0) 00000100:00100000:3.0:1788748457.305173:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:12367:x1875638368688384:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 8678us (8881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.305181:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1788748457.307182:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368688512 00000100:00100000:1.0:1788748457.307195:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368688512 00010000:00010000:1.0:1788748457.307239:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748457.307339:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1788748457.307349:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2411:x1875638368688512:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748457.307364:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748457.307395:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.307410:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.307447:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1ac68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e62 expref: 9 pid: 8427 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.307463:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748457.307468:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748457.307476:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.307486:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.307526:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748457.307539:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1875638388662912:192.168.203.22@tcp:105: 00000100:00100000:1.0:1788748457.307625:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372840 going to sleep for 11 seconds 00010000:00010000:1.0:1788748457.319599:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748457.320208:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1875638388662912:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788748457.320230:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748457.320280:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368688512:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 12931us (15393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748457.320291:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1788748457.320721:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.326106:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368688640 00000100:00100000:2.0:1788748457.326172:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368688640 00002000:00100000:2.0:1788748457.326461:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8adc842fb100 x1875638368688640/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:203/0 lens 504/0 e 0 to 0 dl 1788748468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748457.326507:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc842fb100 with x1875638368688640 ext(0->8) 00002000:00010000:2.0:1788748457.326513:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc842fb100 00000100:00100000:2.0:1788748457.326552:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1788748457.326565:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2413:x1875638368688640:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788748457.327842:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:2413:x1875638368688640:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 1276us (7126us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788748457.327852:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00002000:00100000:2.0:1788748457.327862:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8adc842fb100 x1875638368688640/t4294967315(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:203/0 lens 504/448 e 0 to 0 dl 1788748468 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748457.327872:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc842fb100 with x1875638368688640 ext(0->8) 00002000:00010000:2.0:1788748457.327876:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc842fb100 00000100:00100000:1.0:1788748457.330231:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.330303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368688768 00000100:00100000:2.0:1788748457.330500:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368688768 00000100:00100000:2.0:1788748457.330581:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:2.0:1788748457.330590:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+70:12367:x1875638368688768:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788748457.343903:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788748457.343918:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788748457.343983:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788748457.344000:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8addbf477c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788748457.344004:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc842d2800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8addbf477480 00000020:00080000:3.0:1788748457.344007:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc842d2900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8addb5328200 00000020:00080000:3.0:1788748457.344131:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788748457.344183:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788748457.344399:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388663040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788748457.344474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748457.344525:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388663168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788748457.344550:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748457.344585:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388663040 00000100:00100000:2.0:1788748457.344591:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388663040 00000100:00100000:2.0:1788748457.344638:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388663168 00000100:00100000:2.0:1788748457.344641:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388663168 00000100:00100000:2.0:1788748457.344869:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748457.344879:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388663040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788748457.344905:0:8427:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1788748457.344991:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e22a6, atime: 0x6a9e22a7, ctime: 0x6a9e22a6, blocks: 0x8 00010000:00010000:2.0:1788748457.345000:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.345016:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1788748457.345021:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748457.345027:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.345045:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.345055:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.345062:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.345080:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788748457.345210:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388663040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 332us (735us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788748457.345218:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748457.345236:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788748457.345243:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388663168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788748457.345360:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788748457.345364:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788748458 00002000:00010000:2.0:1788748457.345366:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788748457.345369:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788748458 -> 1788748458 00002000:00010000:2.0:1788748457.345371:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788748457.345526:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345536:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345542:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345548:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bca00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.345553:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345560:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345575:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8adc82598d00) 00010000:00010000:0.0:1788748457.345584:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748457.345590:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345596:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1a997 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345615:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345621:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345627:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345632:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bda00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.345635:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345641:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345648:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748457.345650:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748457.345653:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345673:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1a99e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345687:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345703:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345720:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345725:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.345728:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345734:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345743:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598300) 00010000:00010000:0.0:1788748457.345745:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748457.345748:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345754:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1a9dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345770:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345776:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345782:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345787:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.345796:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345803:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345811:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748457.345814:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748457.345817:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345823:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb800/0x9ba0f20a02e1aae0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345835:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345840:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345845:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345850:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.345853:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345859:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345866:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748457.345868:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748457.345877:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345883:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ab03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345895:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345901:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345907:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.345912:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.345914:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.346102:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388663168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 858us (1549us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788748457.346109:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788748457.346136:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748457.346140:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788748457.346152:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748457.346157:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.346165:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bdc00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748457.346169:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.346176:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.346188:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.346195:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1ac76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.346221:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748457.346223:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748457.346225:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788748457.346261:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc83b0a680/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788748457.346268:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388663168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1788748457.346293:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc849aa300/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788748457.346298:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388663040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788748457.346506:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346518:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748457.346521:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748457.346524:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346530:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb000/0x9ba0f20a02e1ab49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346544:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346549:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346560:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346565:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.346567:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346573:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346580:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:0.0:1788748457.346582:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788748457.346585:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.346590:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ac4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.346804:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:12367:x1875638368688768:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 16213us (16580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748457.346812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:0.0:1788748457.349875:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.350003:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368688896 00000100:00100000:3.0:1788748457.350012:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368688896 00000100:00100000:3.0:1788748457.350070:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1788748457.350080:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:2410:x1875638368688896:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788748457.355442:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788748457.355456:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788748457.355616:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368688896:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 5532us (5744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.355627:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:1.0:1788748457.361028:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.361171:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368689152 00000100:00100000:3.0:1788748457.361186:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368689152 00000100:00100000:3.0:1788748457.361418:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:3.0:1788748457.361430:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:12367:x1875638368689152:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788748457.361482:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748457.361510:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e5b expref: 19 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.361527:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:3.0:1788748457.361533:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748457.361563:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.361577:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.361587:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748457.361887:0:8447:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a78b646b reply state 000000006b77cee5 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.361902:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.361908:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:3.0:1788748457.361910:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748457.361913:0:8447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788748457.362056:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:12367:x1875638368689152:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 628us (1037us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788748457.362064:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:1.0:1788748457.366097:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.366586:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368689280 00000100:00100000:3.0:1788748457.366596:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368689280 00000100:00100000:3.0:1788748457.366652:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1788748457.366669:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368689280:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788748457.366830:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788748457.366834:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788748458 -> 1788748456 00002000:00010000:3.0:1788748457.366836:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788748455 00002000:00010000:3.0:1788748457.366839:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788748458 -> 1788748456 00002000:00010000:3.0:1788748457.366841:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788748457.366899:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368689280:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 239us (810us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788748457.366906:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1788748457.372030:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748457.372491:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368689536 00000100:00100000:0.0:1788748457.372501:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368689536 00000100:00100000:0.0:1788748457.372555:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:0.0:1788748457.372565:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:12367:x1875638368689536:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788748457.372629:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.372644:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.372674:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.372719:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.372742:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 20 pid: 6511 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.372757:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388663296:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748457.372874:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86000 going to sleep for 11 seconds 00000100:00100000:3.0:1788748457.378585:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748457.379049:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388663296:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748457.379077:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.379776:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368689664 00000100:00100000:2.0:1788748457.379785:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368689664 00010000:00010000:2.0:1788748457.379822:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 21 pid: 6511 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.379861:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:2.0:1788748457.379871:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:2411:x1875638368689664:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748457.379886:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748457.379894:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 21 pid: 6511 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.379907:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 21 pid: 6511 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.379998:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd200/0x9ba0f20a02e1ac45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e4d expref: 21 pid: 6511 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.380020:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:2.0:1788748457.380025:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.380034:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.380042:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.380072:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748457.380129:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:2411:x1875638368689664:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 258us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748457.380137:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00010000:00010000:0.0:1788748457.380345:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380353:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380404:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380412:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380419:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380432:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748457.380437:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380444:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380455:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:0.0:1788748457.380457:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788748457.380461:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.380466:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ac84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.380514:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:12367:x1875638368689536:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 7950us (8496us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788748457.380522:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:0.0:1788748457.389113:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748457.389212:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368689792 00000100:00100000:2.0:1788748457.389223:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368689792 00000100:00100000:2.0:1788748457.389276:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1788748457.389286:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2413:x1875638368689792:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788748457.389344:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.389363:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.389372:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748457.389387:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748457.389392:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.389437:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.389452:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 8 pid: 8425 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.389468:0:8734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8734:1875638388663424:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748457.389554:0:8734:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748457.393698:0:8734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8734:1875638388663424:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748457.393734:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.396273:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.396334:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368689920 00000100:00100000:3.0:1788748457.396344:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368689920 00010000:00010000:2.0:1788748457.396520:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 9 pid: 8425 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.396563:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:2.0:1788748457.396576:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2411:x1875638368689920:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748457.396591:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748457.396611:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 9 pid: 8425 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.396626:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 9 pid: 8425 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.396648:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62584aa/0x9ba0f20a02e1ac6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e69 expref: 9 pid: 8425 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.397033:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748457.397046:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748457.397052:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.397064:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.397094:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748457.397155:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.397166:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.397207:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368689920:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 624us (933us total) trans 0 rc 0/0 00010000:00010000:3.0:1788748457.397211:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.397218:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00010000:00010000:3.0:1788748457.397226:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.397234:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.397241:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748457.397245:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.397262:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.397275:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.397472:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050bf343b/0x9ba0f20a02e1ac8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748457.397522:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2413:x1875638368689792:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 8237us (8419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748457.397529:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1788748457.410591:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.413449:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368690176 00000100:00100000:3.0:1788748457.413462:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368690176 00000100:00100000:3.0:1788748457.413515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:3.0:1788748457.413526:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:12367:x1875638368690176:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788748457.413599:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.413615:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 19 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.413625:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.413656:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 19 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.413682:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 19 pid: 8447 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748457.413695:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388663552:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748457.413789:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748457.422355:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748457.422407:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388663552:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748457.422434:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.428788:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368690304 00000100:00100000:0.0:1788748457.428802:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368690304 00010000:00010000:0.0:1788748457.428846:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 20 pid: 8447 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.428884:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:0.0:1788748457.428894:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:2410:x1875638368690304:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748457.428907:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748457.429194:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 20 pid: 8447 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.429220:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 20 pid: 8447 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.429243:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1aad9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3df2 expref: 20 pid: 8447 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.429257:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748457.429263:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.429272:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.429279:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.429312:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748457.429394:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:2410:x1875638368690304:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 501us (7048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748457.429402:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00010000:00010000:1.0:1788748457.429777:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.429786:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.429981:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.429995:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.430003:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.430035:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.430050:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 19 pid: 6510 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748457.430065:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388663680:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748457.430124:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add85372d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748457.450399:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388663680:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748457.450430:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.473555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748457.475209:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368690432 00000100:00100000:0.0:1788748457.475222:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368690432 00010000:00010000:0.0:1788748457.475264:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 20 pid: 6510 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.475340:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:0.0:1788748457.475350:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:2410:x1875638368690432:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748457.475364:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748457.475371:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 20 pid: 6510 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.475384:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 20 pid: 6510 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.475404:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ac53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e54 expref: 20 pid: 6510 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.475429:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:0.0:1788748457.475435:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.475443:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.475451:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.475474:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748457.475522:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:2410:x1875638368690432:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 174us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748457.475529:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00010000:00010000:0.0:1788748457.475553:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.475566:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748457.476104:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788748457.476258:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1788748457.476289:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788748457.476497:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388663808:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788748457.476545:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748457.476583:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86240 going to sleep for 11 seconds 00000100:00100000:1.0:1788748457.477143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388663808 00000100:00100000:1.0:1788748457.477152:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388663808 00000100:00100000:1.0:1788748457.477210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788748457.477219:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875638388663808:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788748457.477339:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875638388663808:12345-0@lo:1000:mdt00_002.0 Request processed in 121us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748457.477345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788748457.477483:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788748457.477489:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc83b0a680, transno 4294967316 00000100:00100000:2.0:1788748457.477509:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388663808:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788748457.477644:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788748457.477781:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388663936:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788748457.477824:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748457.477848:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748457.477864:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388663936 00000100:00100000:2.0:1788748457.477869:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388663936 00000100:00100000:2.0:1788748457.477895:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788748457.477902:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875638388663936:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788748457.478399:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1875638388663936:12345-0@lo:1000:mdt00_002.0 Request processed in 496us (573us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788748457.478407:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788748457.478459:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388663936:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788748457.478494:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478505:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478513:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478519:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748457.478524:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478532:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478546:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:2.0:1788748457.478550:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748457.478554:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478560:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ac99 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478584:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478591:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478598:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478610:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748457.478614:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478621:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478630:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:2.0:1788748457.478633:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748457.478636:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.478642:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1abce lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.480283:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.480308:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 22 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.480330:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.480368:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 22 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748457.480386:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 22 pid: 10244 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.480414:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84939180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388664064:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748457.480496:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748457.486174:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84939180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388664064:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748457.486213:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748457.488454:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748457.492168:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368690560 00000100:00100000:0.0:1788748457.492183:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368690560 00010000:00010000:0.0:1788748457.492245:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 23 pid: 10244 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.492293:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:0.0:1788748457.492303:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:2410:x1875638368690560:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748457.492337:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748457.492344:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 23 pid: 10244 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.492359:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 23 pid: 10244 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.492382:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1abea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e38 expref: 23 pid: 10244 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.492400:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:0.0:1788748457.492422:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.492433:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.492441:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.492476:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748457.492537:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.492548:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:2410:x1875638368690560:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 245us (4102us total) trans 0 rc 0/0 00010000:00010000:3.0:1788748457.492551:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748457.492559:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00010000:00010000:3.0:1788748457.492573:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492582:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492590:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492598:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bdc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748457.492603:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492611:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492622:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748457.492625:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748457.492629:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492636:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1aca0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492648:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492663:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492670:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492690:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748457.492694:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492702:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492721:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8adda17e1200) 00010000:00010000:3.0:1788748457.492724:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788748457.492728:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748457.492734:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ac92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748457.492892:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:12367:x1875638368690176:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 79367us (82308us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788748457.492903:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000020:00080000:3.0:1788748457.492907:0:6512:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788748457.492959:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748457.492964:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748457.493485:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788748457.493495:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748457.497889:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748457.498015:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368690816 00000100:00100000:0.0:1788748457.498025:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368690816 00000100:00100000:0.0:1788748457.498082:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1788748457.498093:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda703a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:12367:x1875638368690816:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788748457.498391:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788748457.498424:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788748457.498459:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.498476:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.498489:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.498498:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.498521:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.498528:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748457.498542:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788748457.498626:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda703a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:12367:x1875638368690816:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 535us (746us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788748457.498634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000020:00080000:0.0:1788748457.498638:0:6514:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788748457.498751:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748457.498759:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.498777:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940a00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748457.498781:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.498789:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.498801:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:1.0:1788748457.498803:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788748457.498809:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.498814:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1aca7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748457.498826:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748457.498827:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748457.498829:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748457.764881:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748457.764906:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388664192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748457.764987:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748457.765112:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388664192 00000100:00100000:0.0:1788748457.765120:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388664192 00000100:00100000:0.0:1788748457.765167:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788748457.765175:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388664192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748457.765218:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788748457.765279:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388664192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748457.765285:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788748457.765642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388664192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788748458.340578:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748459.058566:0:14698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748459.058575:0:14698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748459.058615:0:14698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788748459.058621:0:14698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788748459.216610:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748459.216727:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368691072 00000100:00100000:1.0:1788748459.216737:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368691072 00000100:00100000:1.0:1788748459.216814:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:1.0:1788748459.216824:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:12386:x1875638368691072:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748459.216845:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748459.216864:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1acae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e70 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.216968:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1acb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.216997:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1acb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.217010:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1acb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748459.217023:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788748459.217125:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1acae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e70 expref: 26 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.217141:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1acb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e70 expref: 25 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.217149:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:1.0:1788748459.217152:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748459.217156:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68000, rc 0) 00000100:00100000:1.0:1788748459.217217:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:12386:x1875638368691072:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 394us (616us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788748459.217224:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00080000:3.0:1788748459.217660:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748459.220730:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.221009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368691200 00000100:00100000:3.0:1788748459.221019:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368691200 00000100:00100000:3.0:1788748459.221076:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:3.0:1788748459.221087:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:12386:x1875638368691200:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1788748459.221159:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221176:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221188:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221201:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221207:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221212:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221283:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221290:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221296:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748459.221389:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221404:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221410:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221417:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221820:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.221825:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221833:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221846:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748459.221849:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.221853:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221859:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1acc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221875:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221881:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221895:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221900:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.221903:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221910:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221918:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.221921:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.221924:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221930:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221946:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221952:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221958:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221963:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.221966:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221983:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.221991:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604700) 00010000:00010000:3.0:1788748459.221993:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.221997:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.222002:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748459.222537:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:12386:x1875638368691200:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1446us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748459.222547:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:3.0:1788748459.322145:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.322183:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368691456 00000100:00100000:3.0:1788748459.322193:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368691456 00000100:00100000:3.0:1788748459.322246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:3.0:1788748459.322256:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:12389:x1875638368691456:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748459.322277:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748459.322298:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e77 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322390:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322405:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322802:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322819:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322826:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322832:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322948:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322956:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.322963:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748459.322975:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788748459.323061:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323068:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323074:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323080:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.323091:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323099:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323111:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748459.323114:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.323119:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323125:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1acdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323137:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323143:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323150:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323154:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.323158:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323163:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:3.0:1788748459.323174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.323182:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323188:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ace6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323237:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1acd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323250:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.323257:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.323259:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748459.323261:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77e00, rc 0) 00000100:00100000:3.0:1788748459.323351:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12389:x1875638368691456:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1096us (1216us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788748459.323358:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:1.0:1788748459.331165:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748459.333902:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368691584 00000100:00100000:2.0:1788748459.333918:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368691584 00000100:00100000:2.0:1788748459.334012:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:2.0:1788748459.334025:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12389:x1875638368691584:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1788748459.334098:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334115:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334127:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334162:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334187:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334194:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334200:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bca00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748459.334205:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334213:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334224:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:2.0:1788748459.334228:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748459.334233:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.334239:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1acfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748459.334361:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12389:x1875638368691584:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 339us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748459.334369:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:3.0:1788748459.339859:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748459.344584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368691840 00000100:00100000:2.0:1788748459.344600:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368691840 00000100:00100000:2.0:1788748459.344671:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:2.0:1788748459.344682:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12389:x1875638368691840:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748459.344964:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+28:12389:x1875638368691840:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 283us (5114us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788748459.345763:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00010000:00010000:2.0:1788748459.364498:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748459.387677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748459.387801:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368692096 00000100:00100000:0.0:1788748459.387811:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368692096 00000100:00100000:0.0:1788748459.387874:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:0.0:1788748459.387895:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+28:11913:x1875638368692096:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748459.387923:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748459.387945:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ad02 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e7e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.388089:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.388105:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.388115:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.388150:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.388164:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 29 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748459.388177:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388664320:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748459.388271:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748459.400803:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748459.400953:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368692224 00000100:00100000:1.0:1788748459.400964:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368692224 00010000:00010000:1.0:1788748459.401006:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 30 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748459.401049:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:1.0:1788748459.401059:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:2411:x1875638368692224:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748459.401091:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748459.401098:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 30 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.401113:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 30 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.401136:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:1.0:1788748459.401141:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.401151:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.401158:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.401176:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748459.401231:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:2411:x1875638368692224:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 173us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748459.401238:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00010000:00010000:0.0:1788748459.401373:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aced lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e77 expref: 29 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748459.401391:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388664320:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748459.401423:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.401433:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.401449:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748459.401470:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788748459.401620:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ad02 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.401634:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 29 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.401641:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:0.0:1788748459.401644:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748459.401646:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941a00, rc 0) 00000100:00100000:0.0:1788748459.401685:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:11913:x1875638368692096:12345-192.168.203.22@tcp:101:bash.0 Request processed in 13793us (14018us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788748459.401691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:2.0:1788748459.410085:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.410406:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368692352 00000100:00100000:3.0:1788748459.410417:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368692352 00000100:00100000:3.0:1788748459.410541:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:3.0:1788748459.410552:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:11913:x1875638368692352:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788748459.410576:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748459.410599:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e85 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.410634:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ad1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.410659:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.410671:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ad1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.410805:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e85 expref: 31 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.410825:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ad1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e85 expref: 30 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.410834:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.410837:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788748459.410841:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76000, rc 0) 00000100:00100000:3.0:1788748459.410907:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:11913:x1875638368692352:12345-192.168.203.22@tcp:101:bash.0 Request processed in 358us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748459.410914:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:3.0:1788748459.430145:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748459.430893:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368692608 00000100:00100000:2.0:1788748459.430906:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368692608 00000100:00100000:2.0:1788748459.430973:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:2.0:1788748459.430983:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:11913:x1875638368692608:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1788748459.431210:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.431230:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.431242:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748459.431282:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1788748459.431305:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e2166b5d reply state 00000000f90784f2 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.431419:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.431427:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:2.0:1788748459.431430:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748459.431434:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788748459.431477:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788748459.431757:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:11913:x1875638368692608:12345-192.168.203.22@tcp:36:bash.0 Request processed in 773us (1622us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788748459.431855:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 207 00000020:00080000:2.0:1788748459.431860:0:10244:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788748459.439240:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748459.439716:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368692736 00000100:00100000:1.0:1788748459.439726:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368692736 00000100:00100000:1.0:1788748459.439851:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:1.0:1788748459.439863:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+34:11913:x1875638368692736:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748459.439887:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748459.439907:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ad2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e8c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.439980:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ad2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e8c expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.439994:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ad2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e8c expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.440013:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:1.0:1788748459.440016:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748459.440019:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69200, rc 0) 00000100:00100000:1.0:1788748459.440088:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:11913:x1875638368692736:12345-192.168.203.22@tcp:101:bash.0 Request processed in 226us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748459.440095:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:1.0:1788748459.445609:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.449598:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368692864 00000100:00100000:3.0:1788748459.449613:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368692864 00000100:00100000:2.0:1788748459.449782:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:2.0:1788748459.449793:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:11913:x1875638368692864:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748459.449813:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788748459.449832:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788748459.449838:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e93 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748459.449864:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e22a8, atime: 0x6a9e22a7, ctime: 0x6a9e22a8, blocks: 0x8 00010000:00010000:2.0:1788748459.449887:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788748459.449891:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748459.449899:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.449913:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.449926:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bde00, rc 0) 00000100:00100000:2.0:1788748459.449994:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:11913:x1875638368692864:12345-192.168.203.22@tcp:101:bash.0 Request processed in 202us (4572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748459.450000:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:3.0:1788748459.455561:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748459.455728:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368692992 00000100:00100000:0.0:1788748459.455809:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368692992 00002000:00010000:0.0:1788748459.455858:0:8430:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788748459.455864:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc849a9c00 with x1875638368692992 ext(0->18446744073709551615) 00002000:00010000:0.0:1788748459.455877:0:8430:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc849a9c00. 00000100:00100000:0.0:1788748459.455915:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1788748459.456062:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368692992:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:0.0:1788748459.456604:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788748459.456609:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788748456 -> 1788748460 00002000:00010000:0.0:1788748459.456620:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788748455 -> 1788748455 00002000:00010000:0.0:1788748459.456623:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788748456 -> 1788748460 00002000:00010000:0.0:1788748459.456625:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788748459.456751:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2411:x1875638368692992:12345-192.168.203.22@tcp:10:bash.0 Request processed in 685us (1327us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788748459.456760:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00002000:00010000:0.0:1788748459.456764:0:8430:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788748459.456768:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc849a9c00 with x1875638368692992 ext(0->18446744073709551615) 00002000:00010000:0.0:1788748459.456773:0:8430:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc849a9c00. 00000100:00100000:0.0:1788748459.578547:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.578632:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368693120 00000100:00100000:3.0:1788748459.578642:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368693120 00000100:00100000:3.0:1788748459.578717:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1788748459.578733:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:12403:x1875638368693120:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1788748459.578806:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578838:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578851:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578866:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578874:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578880:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578961:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578971:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.578978:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748459.579024:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579036:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579043:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579062:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579068:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.579072:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579080:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579092:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748459.579096:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.579101:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579108:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ad3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579122:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579128:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579145:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579150:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.579153:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579171:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579181:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:3.0:1788748459.579183:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.579187:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579193:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ad41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579207:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579213:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579218:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579222:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.579224:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579230:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579236:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.579239:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.579241:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.579256:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748459.579381:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:12403:x1875638368693120:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 654us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748459.579561:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:1.0:1788748459.665692:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748459.665916:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368693376 00000100:00100000:2.0:1788748459.665926:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368693376 00000100:00100000:2.0:1788748459.665986:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:2.0:1788748459.665997:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+35:12406:x1875638368693376:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748459.666031:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748459.666050:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1ad4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3e9a expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666132:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666146:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666159:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666174:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666182:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666189:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666293:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ad64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666304:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ad64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.666312:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ad64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748459.666363:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788748459.667043:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667053:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667059:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667065:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.667068:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667075:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667088:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748459.667091:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.667096:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667102:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1ad56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667117:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667131:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667137:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667143:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.667145:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667152:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667159:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598500) 00010000:00010000:3.0:1788748459.667161:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.667164:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667170:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1ad5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667215:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1ad4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e9a expref: 38 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667231:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ad64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e9a expref: 37 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.667239:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.667241:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788748459.667250:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc400, rc 0) 00000100:00100000:3.0:1788748459.667350:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:12406:x1875638368693376:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1321us (1634us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788748459.667358:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:2.0:1788748459.674215:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748459.674408:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368693504 00000100:00100000:0.0:1788748459.674418:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368693504 00000100:00100000:0.0:1788748459.674516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:0.0:1788748459.674527:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:12406:x1875638368693504:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788748459.674592:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.674608:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.674617:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.674652:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.674667:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 37 pid: 6510 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748459.674710:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875638388664448:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748459.674820:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf240 going to sleep for 11 seconds 00000100:00100000:0.0:1788748459.677877:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748459.677973:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368693760 00000100:00100000:2.0:1788748459.677982:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368693760 00000100:00100000:2.0:1788748459.678037:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1788748459.678047:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:6181:x1875638368693760:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788748459.678344:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:6181:x1875638368693760:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 297us (478us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788748459.678353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1788748459.679624:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875638388664448:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748459.679650:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748459.686059:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.686149:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368693888 00000100:00100000:3.0:1788748459.686159:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368693888 00010000:00010000:3.0:1788748459.686199:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 39 pid: 6510 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748459.686241:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:3.0:1788748459.686251:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:2411:x1875638368693888:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748459.686266:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748459.686273:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 39 pid: 6510 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.686288:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 39 pid: 6510 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.686311:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1ad09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e7e expref: 39 pid: 6510 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.686357:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.686361:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.686372:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.686381:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.686438:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748459.686499:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:2411:x1875638368693888:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 249us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748459.686507:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00010000:00010000:1.0:1788748459.686668:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686676:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686726:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686745:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686752:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686758:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748459.686762:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686769:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686778:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:1.0:1788748459.686781:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748459.686785:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.686791:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1ad72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748459.686834:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:12406:x1875638368693504:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 12308us (12627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748459.686842:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:0.0:1788748459.689673:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748459.689851:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368694144 00000100:00100000:2.0:1788748459.689861:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368694144 00000100:00100000:2.0:1788748459.689926:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1788748459.689937:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+37:12406:x1875638368694144:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748459.693960:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:12406:x1875638368694144:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 4014us (4288us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788748459.693974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:1.0:1788748459.812608:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748459.812642:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388664576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748459.812721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748459.812902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388664576 00000100:00100000:3.0:1788748459.812922:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388664576 00000100:00100000:3.0:1788748459.812976:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788748459.812986:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388664576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788748459.813019:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748459.813069:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388664576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748459.813077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788748459.813229:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388664576:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788748459.817475:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1788748459.817506:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1788748459.818294:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748459.818771:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368694400 00000100:00100000:0.0:1788748459.818781:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368694400 00000100:00100000:0.0:1788748459.818842:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:0.0:1788748459.818852:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+38:12417:x1875638368694400:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1788748459.818877:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748459.818900:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ad79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ea1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819041:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819055:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819066:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819079:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819086:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819093:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819209:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ad8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819218:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819225:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ad8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748459.819235:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788748459.819310:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819623:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819783:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819790:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748459.819795:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819803:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819815:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748459.819818:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748459.819822:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819839:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ad80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819853:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819859:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819866:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819870:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748459.819873:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819879:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819887:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adda17e1600) 00010000:00010000:0.0:1788748459.819889:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748459.819892:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.819898:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1ad87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.820012:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1ad79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea1 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.820026:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ad8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea1 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.820040:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:0.0:1788748459.820043:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748459.820046:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748459.820153:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+40:12417:x1875638368694400:12345-192.168.203.22@tcp:101:cat.0 Request processed in 1301us (1863us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788748459.820161:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:1.0:1788748459.827400:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748459.827544:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368694656 00000100:00100000:2.0:1788748459.827555:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368694656 00000100:00100000:2.0:1788748459.827610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788748459.827620:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+40:12417:x1875638368694656:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:2.0:1788748459.828473:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+41:12417:x1875638368694656:12345-192.168.203.22@tcp:35:cat.0 Request processed in 849us (1087us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788748459.828483:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788748459.851668:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.851810:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368694912 00000100:00100000:3.0:1788748459.851820:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368694912 00000100:00100000:3.0:1788748459.851882:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:3.0:1788748459.851892:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb3929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+41:12418:x1875638368694912:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:3.0:1788748459.851961:0:10244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788748459.851988:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1ad2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e8c expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852008:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ad8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea1 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852020:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ad64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e9a expref: 39 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852052:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ad1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e85 expref: 38 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852062:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.852067:0:10244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748459.852086:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852099:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852108:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852122:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852128:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852135:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852210:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852218:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852224:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748459.852740:0:10244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788748459.852752:0:10244:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376839434927ns, next at 377839432153ns, rc = 0 00010000:00010000:3.0:1788748459.852801:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852811:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852820:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852827:0:10244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852834:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852841:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852864:0:10244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748459.852884:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852890:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.852897:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853093:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.853107:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853115:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853126:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:3.0:1788748459.853129:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788748459.853133:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853140:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adaa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853158:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853165:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853170:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853175:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748459.853178:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853184:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853190:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748459.853192:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748459.853203:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853209:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ad9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788748459.853220:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000afa3a038 reply state 000000004fc84e04 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853230:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.853236:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:3.0:1788748459.853238:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788748459.853240:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788748459.853575:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748459.853582:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.853595:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77e00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748459.853598:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.853604:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.853613:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:2.0:1788748459.853615:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788748459.853617:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.853622:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1adb1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748459.853644:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748459.853646:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748459.853647:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748459.853839:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb3929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:12418:x1875638368694912:12345-192.168.203.22@tcp:36:rm.0 Request processed in 1944us (2177us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788748459.853847:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:0.0:1788748459.910394:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748459.910522:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368695168 00000100:00100000:1.0:1788748459.910532:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368695168 00000100:00100000:1.0:1788748459.910594:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:1.0:1788748459.910604:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+39:12424:x1875638368695168:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748459.910637:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748459.910660:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1adb8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ea8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.910767:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.910781:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.910793:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.910803:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.910810:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.910817:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748459.911167:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788748459.911367:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912177:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912190:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912240:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912248:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912255:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912261:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748459.912264:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912272:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912284:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:1.0:1788748459.912287:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748459.912292:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912298:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1adbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748459.912312:0:6511:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001e8c70a6 reply state 00000000763b9537 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912437:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912443:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:1.0:1788748459.912446:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748459.912449:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788748459.912490:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1adb8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 42 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912506:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.912514:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addb5115100) 00010000:00010000:1.0:1788748459.912516:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748459.912519:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68400, rc 0) 00000100:00100000:1.0:1788748459.912594:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:12424:x1875638368695168:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1990us (2217us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788748459.912602:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:1.0:1788748459.918042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.918132:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368695296 00000100:00100000:3.0:1788748459.918142:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368695296 00000100:00080000:2.0:1788748459.918219:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748459.918270:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:3.0:1788748459.918290:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2412:x1875638368695296:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788748459.918308:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748459.918356:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3eaf expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748459.918382:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748459.918412:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1788748459.918417:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748459.918426:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.918663:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748459.918680:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77400, rc 0) 00000100:00100000:3.0:1788748459.918758:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2412:x1875638368695296:12345-192.168.203.22@tcp:101:bash.0 Request processed in 478us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748459.918765:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1788748459.927515:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748459.927602:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368695424 00000100:00100000:0.0:1788748459.927611:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368695424 00000100:00100000:0.0:1788748459.927661:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:0.0:1788748459.927670:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:12424:x1875638368695424:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748459.927687:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748459.927713:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3eb6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.927743:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.927753:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748459.927757:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748459.927762:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.927793:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.927825:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 7 pid: 8427 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748459.927951:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875638388664704:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748459.928042:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1788748459.930865:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748459.931063:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368695552 00000100:00100000:1.0:1788748459.931073:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368695552 00010000:00010000:1.0:1788748459.931111:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 8 pid: 8427 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748459.931160:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:1.0:1788748459.931170:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368695552:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748459.931202:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748459.931232:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 8 pid: 8427 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.931246:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 8 pid: 8427 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.931431:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748459.931436:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748459.931445:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.931454:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748459.931490:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748459.931504:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bdb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1875638388664832:192.168.203.22@tcp:105: 00000100:00100000:1.0:1788748459.931590:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc842cf600 going to sleep for 11 seconds 00010000:00010000:0.0:1788748459.931921:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1addb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eaf expref: 8 pid: 8427 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748459.931938:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1875638388664704:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748459.931961:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748459.931972:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941200, rc 0) 00000100:00100000:0.0:1788748459.932018:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:12424:x1875638368695424:12345-192.168.203.22@tcp:101:bash.0 Request processed in 4348us (4511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748459.932026:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:2.0:1788748459.937210:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748459.937420:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368695808 00000100:00100000:3.0:1788748459.937429:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368695808 00000100:00100000:3.0:1788748459.937476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788748459.937486:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+42:12424:x1875638368695808:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1788748459.938077:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:12424:x1875638368695808:12345-192.168.203.22@tcp:35:bash.0 Request processed in 589us (874us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788748459.938087:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1788748459.939833:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bdb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1875638388664832:192.168.203.22@tcp:105: 00010000:00010000:1.0:1788748459.939923:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748459.939981:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368695552:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 8811us (9126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748459.939993:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:2.0:1788748460.123689:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.123840:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368695936 00000100:00100000:0.0:1788748460.123851:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368695936 00000100:00100000:0.0:1788748460.123921:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:0.0:1788748460.123932:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+43:12440:x1875638368695936:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748460.123969:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748460.123990:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ade9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ebd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.124081:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1adf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.124095:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1adf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.124476:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1adf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748460.124524:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788748460.124529:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748460.124549:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1adf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.124575:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ade9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ebd expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.124592:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1adf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ebd expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.124600:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748460.124603:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748460.124607:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748460.124675:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+44:12440:x1875638368695936:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 745us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.124682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:2.0:1788748460.138132:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748460.138206:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368696192 00000100:00100000:3.0:1788748460.138217:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368696192 00000100:00100000:3.0:1788748460.138281:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:3.0:1788748460.138292:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+44:12440:x1875638368696192:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748460.138353:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748460.138374:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adf7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ec4 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.138756:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1adfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.138772:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1adfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.138807:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1adfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748460.138822:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788748460.138946:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1adf7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ec4 expref: 47 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.138968:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1adfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ec4 expref: 46 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.138978:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addb5115100) 00010000:00010000:2.0:1788748460.138981:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748460.138985:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc200, rc 0) 00000100:00100000:2.0:1788748460.139052:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+46:12440:x1875638368696192:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 761us (929us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788748460.139060:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:2.0:1788748460.141649:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.141686:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748460.141763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368696576 00000100:00100000:1.0:1788748460.141772:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368696576 00000100:00100000:1.0:1788748460.141833:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:1.0:1788748460.141843:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+46:12440:x1875638368696576:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748460.141867:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748460.141885:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1ae0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ecb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.142004:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ae13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.142019:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ae13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.142031:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ae13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748460.142045:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788748460.142142:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68200/0x9ba0f20a02e1ae0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ecb expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.142158:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ae13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ecb expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.142165:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addb5115100) 00010000:00010000:1.0:1788748460.142168:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788748460.142172:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68600, rc 0) 00000100:00100000:1.0:1788748460.142236:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+48:12440:x1875638368696576:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 394us (548us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788748460.142261:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:3.0:1788748460.142424:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368696320 00000100:00100000:3.0:1788748460.142429:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368696320 00000100:00100000:3.0:1788748460.142469:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1788748460.142478:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+48:2412:x1875638368696320:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748460.142488:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748460.142503:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1adfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ec4 expref: 48 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.142514:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addb5115100) 00010000:00010000:3.0:1788748460.142517:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748460.142538:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+47:2412:x1875638368696320:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 62us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748460.142545:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788748460.152407:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748460.152580:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368696704 00000100:00100000:3.0:1788748460.152589:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368696704 00000100:00100000:3.0:1788748460.152652:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1788748460.152662:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+6:2411:x1875638368696704:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:3.0:1788748460.152718:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.152738:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.152748:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788748460.152753:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748460.152758:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.152809:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.152842:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 6 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748460.152857:0:8734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8734:1875638388664960:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748460.152963:0:8734:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748460.155936:0:8734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8734:1875638388664960:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748460.155968:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748460.156812:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.157102:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368696832 00000100:00100000:2.0:1788748460.157110:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368696832 00002000:00100000:2.0:1788748460.157156:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8adc84b7e680 x1875638368696832/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:206/0 lens 504/0 e 0 to 0 dl 1788748471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748460.157167:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84b7e680 with x1875638368696832 ext(0->8) 00010000:00010000:2.0:1788748460.157174:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 7 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.157192:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 7 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748460.157207:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc84b7e680 00000100:00100000:2.0:1788748460.157246:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1788748460.157256:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368696832:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:2.0:1788748460.159461:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2410:x1875638368696832:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 2197us (2643us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788748460.159474:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00100000:2.0:1788748460.159486:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8adc84b7e680 x1875638368696832/t4294967309(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:206/0 lens 504/448 e 0 to 0 dl 1788748471 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788748460.159497:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84b7e680 with x1875638368696832 ext(0->8) 00010000:00010000:2.0:1788748460.159508:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 9 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.159528:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 9 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748460.159537:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8adc84b7e680 00000100:00100000:0.0:1788748460.166501:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.166601:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368696960 00000100:00100000:2.0:1788748460.166611:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368696960 00010000:00010000:2.0:1788748460.166654:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 9 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748460.166711:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1788748460.166723:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2410:x1875638368696960:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748460.166757:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788748460.166774:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788748460.166777:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788748460 00002000:00010000:2.0:1788748460.166780:0:6495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788748460 00002000:00010000:2.0:1788748460.166782:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788748460 00002000:00010000:2.0:1788748460.166784:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788748460.166792:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 9 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.166807:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 9 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.166834:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daeb3f4a/0x9ba0f20a02e1ade2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eb6 expref: 9 pid: 8425 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.166851:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748460.166855:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748460.166861:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.166871:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.166907:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748460.167177:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368696960:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 454us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748460.167185:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00010000:00010000:3.0:1788748460.168100:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168123:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168151:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168160:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168168:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168190:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748460.168195:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168204:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168220:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.168228:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000605c754b/0x9ba0f20a02e1ae21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748460.168305:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368696704:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 15642us (15917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748460.168313:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1788748460.173375:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.173530:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368697216 00000100:00100000:2.0:1788748460.173541:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368697216 00000100:00100000:2.0:1788748460.173601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788748460.173611:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7038450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+47:12440:x1875638368697216:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:2.0:1788748460.173673:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ae13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ecb expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748460.173868:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788748460.173911:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788748460.174730:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788748460.174773:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.174790:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 51 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.174799:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.174853:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 51 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.174870:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 51 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748460.174883:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388665088:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748460.175275:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748460.179070:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.179447:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875638388665088:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748460.179487:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748460.179685:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368697344 00000100:00100000:3.0:1788748460.183283:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368697344 00010000:00010000:2.0:1788748460.185631:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 52 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748460.185754:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1788748460.185767:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+52:2410:x1875638368697344:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748460.185784:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748460.185791:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 52 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.185807:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 52 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.185830:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1adcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ea8 expref: 52 pid: 6511 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.185847:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addb5115100) 00010000:00010000:2.0:1788748460.185852:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.185862:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.185871:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.185906:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748460.185988:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+51:2410:x1875638368697344:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 224us (6928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748460.185996:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00010000:00010000:0.0:1788748460.186054:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.186063:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748460.186201:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788748460.186365:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788748460.186466:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388665216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748460.186523:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.186552:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add889f8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748460.187678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388665216 00000100:00100000:1.0:1788748460.187688:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388665216 00000100:00100000:1.0:1788748460.187765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788748460.187775:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388665216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788748460.187888:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388665216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748460.187895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788748460.188177:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1788748460.188184:0:6514:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1788748460.188205:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc849aa300, transno 4294967308 00000100:00100000:0.0:1788748460.188230:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388665216:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748460.188643:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788748460.188728:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388665344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788748460.188777:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.188800:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add889f8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788748460.188946:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388665344 00000100:00100000:1.0:1788748460.188953:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388665344 00000100:00100000:1.0:1788748460.188998:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788748460.189007:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875638388665344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788748460.189129:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1875638388665344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (352us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788748460.189137:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1788748460.189287:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748460.189422:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875638388665344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788748460.189471:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788748460.189507:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.189516:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.189538:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.189545:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748460.189550:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.189558:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.189575:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addb5115100) 00010000:00010000:0.0:1788748460.189578:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788748460.189583:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.189590:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1ae28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788748460.189685:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788748460.189756:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788748460.189767:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377176450225ns, next at 378176447920ns, rc = 0 00000001:00080000:0.0:1788748460.189773:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788748460.189796:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addb5115100) 00010000:00010000:0.0:1788748460.189799:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788748460.189806:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1ae13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ecb expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748460.189904:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7038450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:12440:x1875638368697216:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 16293us (16539us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788748460.189924:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000020:00080000:0.0:1788748460.189928:0:6514:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788748460.195879:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748460.195962:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368697472 00000100:00100000:3.0:1788748460.195973:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368697472 00000100:00100000:3.0:1788748460.196030:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:3.0:1788748460.196040:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+54:12440:x1875638368697472:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748460.196062:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748460.196084:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ae2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ed2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.196167:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ae2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ed2 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.196182:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ae2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ed2 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.196201:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:3.0:1788748460.196204:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748460.196208:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76000, rc 0) 00000100:00100000:3.0:1788748460.196277:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+55:12440:x1875638368697472:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 238us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748460.196283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:1.0:1788748460.204973:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748460.205189:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368697728 00000100:00100000:3.0:1788748460.205199:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368697728 00000100:00100000:3.0:1788748460.205267:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1788748460.205278:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+55:12440:x1875638368697728:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748460.206753:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12440:x1875638368697728:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 1470us (1783us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788748460.206763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:1.0:1788748460.298772:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.298863:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368697856 00000100:00100000:2.0:1788748460.298872:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368697856 00000100:00100000:2.0:1788748460.298969:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:2.0:1788748460.298980:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12450:x1875638368697856:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:2.0:1788748460.299053:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299071:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299083:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299094:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299101:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299107:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299182:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299207:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299214:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748460.299263:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299276:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299283:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299290:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299296:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748460.299300:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299307:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299366:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748460.299370:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748460.299375:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299382:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299403:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299409:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299416:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299421:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748460.299424:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299430:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299438:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:2.0:1788748460.299440:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748460.299443:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299449:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.299458:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.300614:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.300622:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.300639:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bdc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748460.300643:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.300650:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.300662:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748460.300664:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748460.300668:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.300675:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748460.300787:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12450:x1875638368697856:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1805us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748460.300796:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:0.0:1788748460.324611:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748460.324638:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388665472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748460.324718:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748460.324943:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748460.324954:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388665600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748460.324985:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325217:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388665728:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325257:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325281:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388666240:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325307:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325348:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388666752:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325389:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788748460.325394:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388666112:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325436:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388666624:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325502:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388665728 00000100:00100000:0.0:1788748460.325509:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388665728 00000100:00100000:0.0:1788748460.325553:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788748460.325562:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388665728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325622:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388665728:12345-0@lo:400:kworker.0 Request processed in 49us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.325630:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788748460.325668:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388665856:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325712:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325731:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388666368:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325771:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388666880:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325795:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325813:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788748460.325819:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388665984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325843:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325858:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388666496:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325881:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325899:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388667008:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.325920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748460.325941:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388666240 00000100:00100000:0.0:1788748460.325945:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388666240 00000100:00100000:0.0:1788748460.325970:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388665984 00000100:00100000:0.0:1788748460.325973:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388665984 00000100:00100000:0.0:1788748460.325989:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788748460.325996:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388666240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326033:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388666240:12345-0@lo:400:kworker.0 Request processed in 38us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788748460.326051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788748460.326057:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388665984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326088:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388665984:12345-0@lo:400:kworker.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326103:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788748460.326138:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388665728:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326149:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388666240:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326178:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388665984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326196:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388666112 00000100:00100000:0.0:1788748460.326199:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388666112 00000100:00100000:0.0:1788748460.326218:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388665856 00000100:00100000:0.0:1788748460.326221:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388665856 00000100:00100000:0.0:1788748460.326230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388666368 00000100:00100000:0.0:1788748460.326233:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388666368 00000100:00100000:0.0:1788748460.326251:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388666880 00000100:00100000:0.0:1788748460.326254:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388666880 00000100:00100000:0.0:1788748460.326265:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388666496 00000100:00100000:0.0:1788748460.326267:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388666496 00000100:00100000:0.0:1788748460.326278:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388667008 00000100:00100000:0.0:1788748460.326280:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388667008 00000100:00100000:0.0:1788748460.326293:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788748460.326299:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388666112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326362:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388666112:12345-0@lo:400:kworker.0 Request processed in 63us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326368:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788748460.326379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788748460.326385:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388665856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326411:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388665856:12345-0@lo:400:kworker.0 Request processed in 26us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326416:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788748460.326434:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788748460.326439:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388666368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326466:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388666368:12345-0@lo:400:kworker.0 Request processed in 28us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326472:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788748460.326482:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788748460.326488:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388666880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326511:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388666880:12345-0@lo:400:kworker.0 Request processed in 23us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326516:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788748460.326527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788748460.326532:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388666496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326558:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388666496:12345-0@lo:400:kworker.0 Request processed in 26us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326564:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788748460.326575:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788748460.326581:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388667008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326606:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388667008:12345-0@lo:400:kworker.0 Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326611:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788748460.326638:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388666112:0@lo:400:kworker.0 00010000:00080000:0.0:1788748460.326661:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84a46a00 x1875638388666496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748460.326672:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388666496:0@lo:400:kworker.0 00010000:00080000:0.0:1788748460.326706:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84a46d80 x1875638388667008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748460.326715:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388667008:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326726:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc83b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388665856:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326734:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388666368:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326742:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388666880:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326769:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388666752 00000100:00100000:0.0:1788748460.326773:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388666752 00000100:00100000:0.0:1788748460.326798:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388666624 00000100:00100000:0.0:1788748460.326802:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388666624 00000100:00100000:0.0:1788748460.326820:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788748460.326826:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388666752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326865:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388666752:12345-0@lo:400:kworker.0 Request processed in 39us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326871:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788748460.326883:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788748460.326889:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388666624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326933:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388666624:12345-0@lo:400:kworker.0 Request processed in 44us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.326939:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788748460.326964:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388666624:0@lo:400:kworker.0 00000100:00100000:0.0:1788748460.326975:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388666752:0@lo:400:kworker.0 00000100:00100000:3.0:1788748460.327176:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388665472 00000100:00100000:3.0:1788748460.327185:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388665472 00000100:00100000:3.0:1788748460.327221:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388665600 00000100:00100000:3.0:1788748460.327224:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388665600 00000100:00100000:3.0:1788748460.327239:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788748460.327245:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388665472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748460.327273:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748460.327347:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388665472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748460.327348:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788748460.327353:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788748460.327357:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388665600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748460.327368:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788748460.327376:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748460.327379:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748460.327382:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748460.327384:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748460.327403:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388665600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748460.327408:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788748460.327445:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388665600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748460.327596:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388665472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748460.352730:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.352852:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368698112 00000100:00100000:2.0:1788748460.352861:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368698112 00000100:00100000:2.0:1788748460.352911:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:2.0:1788748460.352921:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+56:12453:x1875638368698112:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748460.352941:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748460.352977:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ed9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353053:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353069:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353081:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353092:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353100:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353106:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353214:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1ae60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353224:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1ae60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353232:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1ae60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748460.353242:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788748460.353371:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353709:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353717:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353724:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748460.353728:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353736:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353748:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748460.353752:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748460.353756:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353763:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353776:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353783:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353789:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353794:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748460.353802:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353809:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353816:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:2.0:1788748460.353818:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748460.353821:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353826:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1ae59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353861:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1ae4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ed9 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353874:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1ae60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ed9 expref: 58 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.353882:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748460.353884:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748460.353887:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc000, rc 0) 00000100:00100000:2.0:1788748460.353950:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12453:x1875638368698112:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1029us (1229us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788748460.354005:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:3.0:1788748460.368891:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.368979:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368698240 00000100:00100000:0.0:1788748460.368988:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368698240 00000100:00100000:0.0:1788748460.369052:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:0.0:1788748460.369063:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12453:x1875638368698240:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788748460.369125:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369141:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369152:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369188:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369195:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369202:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369208:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748460.369212:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369219:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369229:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748460.369232:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748460.369251:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.369555:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748460.369636:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12453:x1875638368698240:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 574us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.369644:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:1.0:1788748460.373158:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.373464:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368698496 00000100:00100000:0.0:1788748460.373473:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368698496 00000100:00100000:0.0:1788748460.373618:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:0.0:1788748460.373629:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+58:12453:x1875638368698496:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1788748460.373875:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:12453:x1875638368698496:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 247us (726us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788748460.373884:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00010000:00010000:1.0:1788748460.389649:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748460.513865:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748460.514032:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368698752 00000100:00100000:3.0:1788748460.514042:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368698752 00000100:00100000:3.0:1788748460.514101:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:3.0:1788748460.514111:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+59:12463:x1875638368698752:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788748460.514136:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748460.514140:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788748460.514167:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1adf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ebd expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.514187:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748460.514192:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748460.514214:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ae75 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ee0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.514770:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ae7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.514787:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ae7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.514799:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ae7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748460.514810:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788748460.514998:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1ae75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee0 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.515043:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ae7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee0 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.515052:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:3.0:1788748460.515055:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788748460.515058:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77400, rc 0) 00000100:00100000:3.0:1788748460.515250:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:12463:x1875638368698752:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1140us (1393us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788748460.515274:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:3.0:1788748460.530443:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.530739:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368698880 00000100:00100000:0.0:1788748460.530750:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368698880 00000100:00100000:0.0:1788748460.530816:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:0.0:1788748460.530827:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:12463:x1875638368698880:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788748460.530854:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748460.530876:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ee7 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.530924:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.530940:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.530972:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.531087:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 62 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.531107:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 61 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.531116:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748460.531119:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748460.531122:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748460.531188:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:12463:x1875638368698880:12345-192.168.203.22@tcp:101:bash.0 Request processed in 362us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.531195:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:0.0:1788748460.537159:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748460.537749:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368699008 00000100:00100000:1.0:1788748460.537760:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368699008 00000100:00100000:1.0:1788748460.537835:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788748460.537846:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+61:2411:x1875638368699008:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748460.537860:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748460.537885:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77400/0x9ba0f20a02e1ae7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee0 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.537914:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:1.0:1788748460.537920:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748460.537980:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:2411:x1875638368699008:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 136us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748460.537987:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1788748460.542097:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.542252:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368699264 00000100:00100000:0.0:1788748460.542273:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368699264 00000100:00100000:0.0:1788748460.542516:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 224 00000100:00100000:0.0:1788748460.542527:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+60:12463:x1875638368699264:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:0.0:1788748460.542594:0:10244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748460.542620:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1ae60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ed9 expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.542638:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748460.542643:0:10244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748460.542830:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.542846:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.542855:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788748460.542895:0:10244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788748460.542916:0:10244:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b9c587ee reply state 0000000098306d0a transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.542928:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.542935:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748460.542937:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788748460.542940:0:10244:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748460.543036:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:12463:x1875638368699264:12345-192.168.203.22@tcp:36:bash.0 Request processed in 510us (949us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788748460.543044:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 224 00000020:00080000:0.0:1788748460.543049:0:10244:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788748460.554198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.559082:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368699392 00000100:00100000:2.0:1788748460.559097:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368699392 00000100:00100000:2.0:1788748460.559205:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:2.0:1788748460.559216:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+62:12463:x1875638368699392:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748460.559241:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748460.559469:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3eee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.559737:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.559753:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.559766:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748460.559798:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788748460.559803:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748460.559822:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.559852:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1ae9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.559870:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.559879:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748460.559882:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748460.559885:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bda00, rc 0) 00000100:00100000:2.0:1788748460.561129:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12463:x1875638368699392:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1906us (6931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748460.561152:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:1.0:1788748460.574143:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.574219:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368699648 00000100:00100000:0.0:1788748460.574229:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368699648 00000100:00100000:0.0:1788748460.574302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1788748460.574313:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+63:12463:x1875638368699648:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1788748460.574579:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12463:x1875638368699648:12345-192.168.203.22@tcp:35:bash.0 Request processed in 267us (445us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788748460.574587:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1788748460.673011:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748460.673164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368699776 00000100:00100000:3.0:1788748460.673175:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368699776 00000100:00100000:3.0:1788748460.673243:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:3.0:1788748460.673264:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+64:12469:x1875638368699776:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748460.673290:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748460.673311:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1aead lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3ef5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.673416:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aeb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.673431:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.673444:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748460.673498:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788748460.673502:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748460.673522:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.673546:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1aead lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ef5 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.673564:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ef5 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748460.673571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748460.673574:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748460.673578:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77e00, rc 0) 00000100:00100000:3.0:1788748460.673642:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12469:x1875638368699776:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 380us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748460.673649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:3.0:1788748460.676704:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.676798:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368699904 00000100:00100000:0.0:1788748460.676807:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368699904 00000100:00100000:0.0:1788748460.676871:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:0.0:1788748460.676881:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12469:x1875638368699904:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788748460.676910:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748460.676931:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1aebb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3efc expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.676994:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677007:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677019:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677030:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677038:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677045:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677116:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aed0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677125:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677152:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748460.677197:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788748460.677202:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748460.677221:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677233:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677242:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677262:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677270:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677277:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748460.677281:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677290:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677302:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:0.0:1788748460.677305:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748460.677311:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677383:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1aec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677399:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677405:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677412:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677417:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748460.677421:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677428:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677436:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:0.0:1788748460.677439:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748460.677442:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677447:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1aec9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677476:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1aebb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3efc expref: 67 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677502:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aed0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3efc expref: 66 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.677509:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748460.677511:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748460.677514:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941600, rc 0) 00000100:00100000:0.0:1788748460.677583:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:12469:x1875638368699904:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 703us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.677590:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:1.0:1788748460.680835:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748460.680883:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.680963:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368700288 00000100:00100000:0.0:1788748460.680973:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368700288 00000100:00100000:0.0:1788748460.681053:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1788748460.681063:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:2410:x1875638368700288:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748460.681078:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748460.681102:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aed0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3efc expref: 66 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.681121:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748460.681127:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748460.681186:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:2410:x1875638368700288:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 125us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.681193:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788748460.681372:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368700160 00000100:00100000:2.0:1788748460.681378:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368700160 00000100:00100000:2.0:1788748460.681419:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:2.0:1788748460.681427:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12469:x1875638368700160:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748460.681444:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748460.681460:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aed7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f03 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.681566:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.681581:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.681590:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.681630:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.681647:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 66 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748460.681660:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388667136:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748460.681745:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788748460.683651:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875638388667136:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748460.683703:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748460.684233:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748460.684647:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368700416 00000100:00100000:1.0:1788748460.684655:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368700416 00010000:00010000:1.0:1788748460.684706:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 67 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748460.684746:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:1.0:1788748460.684756:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:2411:x1875638368700416:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748460.684770:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748460.684777:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 67 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.684804:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 67 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.684827:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1aea6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3eee expref: 67 pid: 6510 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.684842:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:1.0:1788748460.684848:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.684858:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.684867:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.684972:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748460.685035:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:2411:x1875638368700416:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 279us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748460.685043:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00010000:00010000:0.0:1788748460.688088:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.688105:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748460.688146:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788748460.688298:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1aed7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.688353:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.688362:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748460.688365:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788748460.688369:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd800, rc 0) 00000100:00100000:0.0:1788748460.688435:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:12469:x1875638368700160:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 7008us (7610us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788748460.688444:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:3.0:1788748460.695800:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748460.695900:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368700672 00000100:00100000:2.0:1788748460.695910:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368700672 00000100:00100000:2.0:1788748460.696017:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788748460.696033:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:12469:x1875638368700672:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:2.0:1788748460.696049:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748460.696087:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1ae2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ed2 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748460.696107:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748460.696113:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748460.696170:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12469:x1875638368700672:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 144us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748460.696178:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788748460.704032:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748460.704449:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368700800 00000100:00100000:0.0:1788748460.704470:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368700800 00000100:00100000:0.0:1788748460.704543:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:0.0:1788748460.704553:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12469:x1875638368700800:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:0.0:1788748460.704678:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.704707:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748460.704720:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748460.704822:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788748460.704968:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12469:x1875638368700800:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 415us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748460.704975:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:3.0:1788748460.708744:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748460.708857:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368700928 00000100:00100000:1.0:1788748460.708866:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368700928 00000100:00100000:1.0:1788748460.708964:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:1.0:1788748460.708976:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+65:12469:x1875638368700928:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748460.708998:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748460.709021:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.709104:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.709121:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.709140:0:6511:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.709153:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.709166:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:1.0:1788748460.709169:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748460.709173:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748460.709181:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69000, rc 0) 00000100:00100000:1.0:1788748460.709249:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:12469:x1875638368700928:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 275us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748460.709257:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:0.0:1788748460.836904:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748460.837069:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388667392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748460.837802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748460.837949:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388667392 00000100:00100000:3.0:1788748460.837958:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388667392 00000100:00100000:3.0:1788748460.838008:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788748460.838017:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388667392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748460.838047:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788748460.838101:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388667392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748460.838123:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788748460.838647:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388667392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748460.838657:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388667264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748460.838703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748460.850019:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388667264 00000100:00100000:1.0:1788748460.850032:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388667264 00000100:00100000:1.0:1788748460.850085:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788748460.850095:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388667264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748460.850119:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788748460.850846:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388667264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 749us (12139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748460.850866:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788748460.853684:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388667264:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788748461.412809:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748461.604679:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748461.604700:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748461.604727:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788748461.604737:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748461.604879:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbe680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388667520:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748461.604997:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748461.610411:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.610706:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368701056 00000100:00100000:0.0:1788748461.610716:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368701056 00000100:00100000:0.0:1788748461.610803:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:0.0:1788748461.610815:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368701056:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788748461.610849:0:6510:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788748461.610992:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368701056:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 179us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748461.611000:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00080000:3.0:1788748461.611243:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748461.611350:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbe680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388667520:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788748461.623903:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.624144:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368701184 00000100:00100000:2.0:1788748461.624153:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368701184 00000100:00100000:2.0:1788748461.624214:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:2.0:1788748461.624237:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:12470:x1875638368701184:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788748461.624354:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624379:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624404:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624424:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624432:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624439:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624463:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624472:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624480:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748461.624528:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788748461.624532:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748461.624546:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624572:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624579:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624587:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624593:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bca00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.624598:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624605:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624617:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:2.0:1788748461.624621:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.624626:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624632:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aefa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624852:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624861:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624867:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624880:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.624883:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624890:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624898:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8adc82598c00) 00010000:00010000:2.0:1788748461.624900:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.624903:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624908:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af01 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624923:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624929:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624934:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624938:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bda00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.624941:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624946:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.624963:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748461.625035:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.625040:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.625045:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.625138:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:12470:x1875638368701184:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 902us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.625145:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:1.0:1788748461.639762:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.639926:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368701440 00000100:00100000:3.0:1788748461.639936:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368701440 00000100:00100000:3.0:1788748461.640003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:3.0:1788748461.640013:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+66:12470:x1875638368701440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748461.640032:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748461.640053:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1af0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f11 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640171:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640185:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640198:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748461.640208:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788748461.640280:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640287:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640294:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640352:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748461.640357:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640365:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640656:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:3.0:1788748461.640661:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788748461.640668:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640674:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1af16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640730:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1af0f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f11 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640742:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:3.0:1788748461.640744:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788748461.640748:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1af0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f11 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.640759:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77800, rc 0) 00000100:00100000:3.0:1788748461.640832:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368701440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 820us (1078us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1788748461.640840:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:0.0:1788748461.645419:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.645501:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368701568 00000100:00100000:2.0:1788748461.645511:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368701568 00000100:00100000:2.0:1788748461.645571:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:2.0:1788748461.645581:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368701568:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748461.645619:0:6510:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748461.645756:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368701568:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 176us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.645763:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:0.0:1788748461.651924:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.651989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368701824 00000100:00100000:3.0:1788748461.652012:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368701824 00000100:00100000:3.0:1788748461.652075:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 235 00000100:00100000:3.0:1788748461.652085:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add83a4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368701824:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748461.652106:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748461.652109:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788748461.652135:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1aeb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ef5 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.652153:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:3.0:1788748461.652158:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748461.652170:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1af24 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f18 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788748461.652585:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788748461.668879:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.668901:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.668913:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.668995:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1af24 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f18 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.669014:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f18 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.669022:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1600) 00010000:00010000:0.0:1788748461.669025:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788748461.669028:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941a00, rc 0) 00000100:00100000:0.0:1788748461.669106:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add83a4c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:12470:x1875638368701824:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 17021us (17190us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788748461.669115:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 235 00000100:00100000:1.0:1788748461.674992:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.675333:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368702080 00000100:00100000:2.0:1788748461.675345:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368702080 00000100:00100000:2.0:1788748461.675411:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00100000:2.0:1788748461.675421:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:12470:x1875638368702080:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748461.675479:0:8447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748461.675506:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f18 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675543:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1600) 00010000:00010000:2.0:1788748461.675554:0:8447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748461.675576:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675589:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675599:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675613:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675620:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675626:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675665:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675672:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675690:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675697:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bda00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.675701:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675715:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675725:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748461.675728:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.675733:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675739:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bda00/0x9ba0f20a02e1af39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675750:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675756:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675763:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675769:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.675772:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675776:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675783:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6950afba (ffff8adc82598c00) 00010000:00010000:2.0:1788748461.675786:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.675788:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.675805:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1af40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6950afba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.675892:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368702080:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 471us (907us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748461.675900:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00100000:3.0:1788748461.680644:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.680787:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368702208 00000100:00100000:0.0:1788748461.680798:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368702208 00000100:00100000:0.0:1788748461.680864:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:0.0:1788748461.680875:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+67:12470:x1875638368702208:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748461.680895:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748461.680918:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f1f expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.680953:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.680966:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.680978:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.681094:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 69 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.681112:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 68 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.681120:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:0.0:1788748461.681123:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748461.681126:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941200, rc 0) 00000100:00100000:0.0:1788748461.681794:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:12470:x1875638368702208:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 917us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748461.681803:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:1.0:1788748461.689593:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.689695:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368702464 00000100:00100000:0.0:1788748461.689705:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368702464 00000100:00100000:0.0:1788748461.689768:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:0.0:1788748461.689778:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+68:12470:x1875638368702464:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748461.689864:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.689882:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.689894:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788748461.690042:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788748461.690051:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378676734283ns, next at 379676731983ns, rc = 0 00000004:00010000:0.0:1788748461.690117:0:6512:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002a602faa reply state 00000000d6c35995 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.690130:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.690138:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:0.0:1788748461.690141:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788748461.690156:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788748461.690260:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+70:12470:x1875638368702464:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 483us (676us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788748461.690268:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:2.0:1788748461.703143:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.703373:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368702592 00000100:00100000:3.0:1788748461.703383:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368702592 00000100:00100000:3.0:1788748461.703441:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:3.0:1788748461.703450:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+70:12470:x1875638368702592:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748461.703474:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748461.703493:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f26 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.703544:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 71 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.703557:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 71 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.703587:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:3.0:1788748461.703590:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788748461.703594:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77e00, rc 0) 00000100:00100000:3.0:1788748461.703645:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+71:12470:x1875638368702592:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 196us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.703652:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:3.0:1788748461.707749:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.707941:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368702720 00000100:00100000:0.0:1788748461.707951:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368702720 00000100:00100000:0.0:1788748461.708065:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1788748461.708077:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2411:x1875638368702720:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788748461.708831:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:2411:x1875638368702720:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 752us (1087us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788748461.708840:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00080000:3.0:1788748461.709798:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748461.712614:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.714595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368702976 00000100:00100000:2.0:1788748461.714610:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368702976 00000100:00100000:2.0:1788748461.714694:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1788748461.714705:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+71:12470:x1875638368702976:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788748461.715195:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+72:12470:x1875638368702976:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 490us (2935us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788748461.715204:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1788748461.723646:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.723794:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368703232 00000100:00100000:0.0:1788748461.723805:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368703232 00000100:00100000:0.0:1788748461.723876:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1788748461.723886:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+72:12470:x1875638368703232:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788748461.724008:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+72:12470:x1875638368703232:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 122us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748461.724015:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1788748461.727360:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.727505:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368703360 00000100:00100000:2.0:1788748461.727515:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368703360 00000100:00100000:2.0:1788748461.727574:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:2.0:1788748461.727584:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+72:12470:x1875638368703360:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748461.727604:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748461.727623:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1af63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f2d expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.727713:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1af6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.727746:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1af6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.727757:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1af6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748461.727803:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748461.727836:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1af6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.727863:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1af63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f2d expref: 74 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.727881:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1af6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f2d expref: 73 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.727900:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:2.0:1788748461.727904:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788748461.727907:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc000, rc 0) 00000100:00100000:2.0:1788748461.727959:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+73:12470:x1875638368703360:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 376us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.727966:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:1.0:1788748461.733446:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.733563:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368703488 00000100:00100000:3.0:1788748461.733576:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368703488 00000100:00100000:3.0:1788748461.733638:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1788748461.733647:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+10:2411:x1875638368703488:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788748461.733665:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748461.733697:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f34 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748461.733723:0:8734:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e22ae, blocks: 0x0 00010000:00010000:3.0:1788748461.733742:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1788748461.733747:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748461.733756:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 11 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.733772:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 11 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.733805:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76000, rc 0) 00000100:00100000:3.0:1788748461.733863:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:2411:x1875638368703488:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 217us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.733870:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:1.0:1788748461.740642:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.740878:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368703744 00000100:00100000:3.0:1788748461.740888:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368703744 00000100:00100000:3.0:1788748461.740958:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:3.0:1788748461.740969:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+73:12470:x1875638368703744:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788748461.741082:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+73:12470:x1875638368703744:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 116us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.741090:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:0.0:1788748461.744528:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.744618:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368703872 00000100:00100000:2.0:1788748461.744628:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368703872 00000100:00100000:2.0:1788748461.744699:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1788748461.744710:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:12470:x1875638368703872:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748461.744729:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748461.744763:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f3b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.744796:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 12 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.744812:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748461.744816:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748461.744822:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.744859:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 12 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.744875:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 12 pid: 8734 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.744891:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875638388667648:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748461.745253:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748461.751198:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.751479:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368704000 00000100:00100000:0.0:1788748461.751489:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368704000 00010000:00010000:0.0:1788748461.751530:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 13 pid: 8734 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748461.751573:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:0.0:1788748461.751583:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:2410:x1875638368704000:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748461.751598:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748461.751622:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 13 pid: 8734 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.751646:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 13 pid: 8734 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.751671:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748461.751675:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748461.751691:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.751700:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.751737:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748461.751768:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1875638388667776:192.168.203.22@tcp:105: 00000100:00100000:0.0:1788748461.751866:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3c0b3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788748461.752878:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000605c754b/0x9ba0f20a02e1af71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f34 expref: 13 pid: 8734 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.752909:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8427:1875638388667648:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748461.752936:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.752968:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc400, rc 0) 00000100:00100000:2.0:1788748461.753011:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+12:12470:x1875638368703872:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 8302us (8492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.753019:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:0.0:1788748461.757230:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1875638388667776:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788748461.757257:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748461.757341:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:2410:x1875638368704000:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 5734us (6127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748461.757352:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:1.0:1788748461.764926:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.765184:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368704128 00000100:00100000:0.0:1788748461.765194:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368704128 00002000:00100000:0.0:1788748461.765246:0:8430:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8adc84bd8a80 x1875638368704128/t0(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:207/0 lens 504/0 e 0 to 0 dl 1788748472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748461.765257:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84bd8a80 with x1875638368704128 ext(0->12) 00002000:00010000:0.0:1788748461.765263:0:8430:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc84bd8a80 00000100:00100000:0.0:1788748461.765296:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:0.0:1788748461.765305:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+11:2411:x1875638368704128:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788748461.766694:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:2411:x1875638368704128:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 1376us (1764us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788748461.766706:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00002000:00100000:0.0:1788748461.766715:0:8430:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8adc84bd8a80 x1875638368704128/t4294967321(0) o4->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:207/0 lens 504/448 e 0 to 0 dl 1788748472 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788748461.766725:0:8430:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc84bd8a80 with x1875638368704128 ext(0->12) 00002000:00010000:0.0:1788748461.766731:0:8430:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc84bd8a80 00000100:00100000:1.0:1788748461.771749:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.771860:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368704256 00000100:00100000:3.0:1788748461.771870:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368704256 00000100:00100000:3.0:1788748461.771968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 243 00000100:00100000:3.0:1788748461.771980:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+73:12470:x1875638368704256:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788748461.776523:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788748461.776538:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788748461.776574:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788748461.776595:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8add889f80c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788748461.776600:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8add860e1b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8add889f8e40 00000020:00080000:1.0:1788748461.776603:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8addb3a57f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc84bb6400 00000020:00080000:3.0:1788748461.776735:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788748461.776752:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388668032:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788748461.776814:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.776824:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748461.776831:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.776840:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.776848:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76400 already unused, calling callback (ffffffffc191c4f0) 00000100:00100000:3.0:1788748461.776866:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748461.776873:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388667904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788748461.776897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748461.776913:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.776922:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.776932:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388668032 00000100:00100000:3.0:1788748461.776941:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388668032 00010000:00010000:2.0:1788748461.776941:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8adc82598200) 00010000:00010000:2.0:1788748461.776946:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.776952:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.776960:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76400/0x9ba0f20a02e1ac7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.776983:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388667904 00010000:00010000:2.0:1788748461.776991:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.776999:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388667904 00010000:00010000:2.0:1788748461.777009:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.777016:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.777022:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bcc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.777026:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.777031:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1788748461.777039:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.777047:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388668032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788748461.777171:0:8424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788748461.777175:0:8424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788748462 00002000:00010000:3.0:1788748461.777177:0:8424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788748461.777179:0:8424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788748462 -> 1788748462 00002000:00010000:3.0:1788748461.777181:0:8424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788748461.777222:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1875638388668032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (402us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788748461.777229:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788748461.777245:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788748461.777444:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388667904:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788748461.777764:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788748461.777806:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8addb533b900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788748461.777810:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc84843500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8addb533b6c0 00000020:00080000:1.0:1788748461.777813:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc84843400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc84bb6800 00000020:00080000:1.0:1788748461.777828:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788748461.777846:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788748461.778165:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1788748461.778234:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8addbc604b00) 00010000:00010000:2.0:1788748461.778239:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.778245:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778253:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bcc00/0x9ba0f20a02e1ad25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778279:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778285:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778292:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778298:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.778311:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778331:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778342:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:2.0:1788748461.778344:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.778347:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.778353:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77000/0x9ba0f20a02e1ada3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788748461.778393:0:8424:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1788748461.778413:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.778432:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.778441:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788748461.778445:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788748461.778450:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748461.778512:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388668160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788748461.778555:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748461.778585:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388668160 00000100:00100000:0.0:1788748461.778591:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388668160 00000100:00100000:0.0:1788748461.778615:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788748461.778622:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875638388668160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788748461.778635:0:8425:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1788748461.778654:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e22ac, atime: 0x6a9e22ac, ctime: 0x6a9e22ac, blocks: 0x8 00010000:00010000:0.0:1788748461.778660:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.778944:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788748461.778948:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748461.778955:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.778969:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.778978:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.778988:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.779010:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748461.779019:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.779068:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 12 pid: 8425 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.779081:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388668288:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748461.779151:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b210c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788748461.779189:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc849ab800/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788748461.779197:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388668032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788748461.779445:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:12470:x1875638368704256:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 7468us (7706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.779524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 243 00010000:00010000:1.0:1788748461.780481:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748461.780490:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.780516:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940a00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748461.780521:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.780531:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.780548:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.780556:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c3e4155/0x9ba0f20a02e1af86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.780577:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748461.780578:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748461.780580:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748461.780776:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780789:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780796:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780802:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69c00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.780805:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780812:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780823:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8addbc604700) 00010000:00010000:2.0:1788748461.780826:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.780835:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780842:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1adc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780876:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780883:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780889:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780894:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.780897:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780903:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780910:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748461.780912:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.780915:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780921:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1ae98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780931:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780937:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780948:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780953:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.780956:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780962:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780969:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:2.0:1788748461.780971:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748461.780974:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.780980:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940400/0x9ba0f20a02e1af55 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748461.781289:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388668160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2662us (2729us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788748461.781304:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1788748461.781385:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc84a46300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788748461.781393:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388668160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788748461.786312:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748461.786386:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.786467:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368704512 00000100:00100000:2.0:1788748461.786476:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368704512 00010000:00010000:2.0:1788748461.786516:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 13 pid: 8425 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.786569:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:2.0:1788748461.786580:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:2410:x1875638368704512:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748461.786594:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748461.786599:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 13 pid: 8425 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.786633:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 13 pid: 8425 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.786660:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748461.786664:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748461.786670:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.786687:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.786709:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748461.786760:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:2410:x1875638368704512:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.786768:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:0.0:1788748461.787051:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368704384 00000100:00100000:0.0:1788748461.787056:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368704384 00000100:00100000:0.0:1788748461.787095:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:0.0:1788748461.787103:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+13:2410:x1875638368704384:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788748461.787764:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d409f01b/0x9ba0f20a02e1ad33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e93 expref: 13 pid: 8425 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.787783:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388668288:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748461.787807:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.787908:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.787918:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.787929:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.787937:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.787999:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748461.788075:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748461.788083:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.788092:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748461.788096:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.788117:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.788133:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.788140:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1af7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.788160:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748461.788162:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748461.788164:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748461.790099:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1875638388667904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12841us (13194us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788748461.790110:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1788748461.790213:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc849ab100/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788748461.790221:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388667904:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788748461.793695:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788748461.793711:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1788748461.793949:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368704384:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 6840us (7639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748461.793962:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:2.0:1788748461.815780:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.818050:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368704768 00000100:00100000:3.0:1788748461.818081:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368704768 00000100:00100000:2.0:1788748461.818776:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 244 00000100:00100000:2.0:1788748461.818788:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:12470:x1875638368704768:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748461.818844:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748461.818872:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1af6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f2d expref: 21 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.818892:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:2.0:1788748461.818897:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748461.818937:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.818953:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.818963:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748461.819080:0:6510:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000092a6fac7 reply state 00000000495c339e transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.819106:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.819112:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:2.0:1788748461.819114:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748461.819117:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748461.819227:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:12470:x1875638368704768:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 442us (3457us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788748461.819235:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 244 00000100:00100000:3.0:1788748461.828969:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.831757:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368704896 00000100:00100000:0.0:1788748461.831773:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368704896 00000100:00100000:2.0:1788748461.832085:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:2.0:1788748461.832100:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368704896:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788748461.832250:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788748461.832254:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788748462 -> 1788748461 00002000:00010000:2.0:1788748461.832266:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788748460 00002000:00010000:2.0:1788748461.832268:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788748462 -> 1788748461 00002000:00010000:2.0:1788748461.832273:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788748461.832370:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368704896:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 274us (3411us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788748461.832378:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:1.0:1788748461.842129:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.842260:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368705152 00000100:00100000:0.0:1788748461.842269:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368705152 00000100:00100000:0.0:1788748461.842361:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 245 00000100:00100000:0.0:1788748461.842381:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:12470:x1875638368705152:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788748461.842458:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.842476:0:10244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 22 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.842486:0:10244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.842520:0:10244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 22 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.842534:0:10244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 22 pid: 10244 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748461.842564:0:10244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a45500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388668416:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748461.842656:0:10244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3c0b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788748461.845725:0:10244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a45500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388668416:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748461.845754:0:10244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748461.850739:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.851086:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368705280 00000100:00100000:3.0:1788748461.851096:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368705280 00010000:00010000:3.0:1788748461.851148:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 23 pid: 10244 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.851192:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:3.0:1788748461.851202:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+23:2410:x1875638368705280:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748461.851216:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748461.851224:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 23 pid: 10244 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.851239:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 23 pid: 10244 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.851272:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941200/0x9ba0f20a02e1af4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f1f expref: 23 pid: 10244 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.851290:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:3.0:1788748461.851296:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.851307:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.851364:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.851398:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748461.851666:0:10244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851695:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851737:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851744:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851750:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851756:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.851760:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851767:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851776:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:2.0:1788748461.851779:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788748461.851783:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.851789:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1af94 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.851854:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:12470:x1875638368705152:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 9483us (9744us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788748461.851862:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 245 00000100:00100000:3.0:1788748461.852282:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:2410:x1875638368705280:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1079us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.852291:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:1.0:1788748461.858871:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.859051:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368705408 00000100:00100000:2.0:1788748461.859061:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368705408 00000100:00100000:2.0:1788748461.859128:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:2.0:1788748461.859138:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368705408:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788748461.859184:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.859205:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.859214:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748461.859218:0:8424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748461.859222:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.859268:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.859283:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 8 pid: 8427 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.859298:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388668544:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748461.859409:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748461.864144:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8424:1875638388668544:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748461.864173:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748461.866903:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.867038:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368705536 00000100:00100000:2.0:1788748461.867047:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368705536 00010000:00010000:2.0:1788748461.867088:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 9 pid: 8427 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.867158:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:2.0:1788748461.867169:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+9:2411:x1875638368705536:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748461.867184:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748461.867205:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 9 pid: 8427 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.867219:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 9 pid: 8427 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.867241:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042ba835e/0x9ba0f20a02e1af78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f3b expref: 9 pid: 8427 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.867267:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748461.867272:0:9515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788748461.867277:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.867287:0:9515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.867377:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748461.867436:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368705536:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 269us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.867443:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00010000:00010000:3.0:1788748461.867778:0:8424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867790:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867811:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867820:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867828:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867835:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bdc00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748461.867850:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867859:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867872:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.867893:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dd4dfb9/0x9ba0f20a02e1af9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.867953:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368705408:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 8816us (9093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.867962:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:1.0:1788748461.873860:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.873941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368705792 00000100:00100000:3.0:1788748461.873951:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368705792 00000100:00100000:3.0:1788748461.874009:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 246 00000100:00100000:3.0:1788748461.874020:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:12470:x1875638368705792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788748461.874101:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.874128:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 21 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.874139:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.874173:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 21 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.874190:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 21 pid: 8447 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.874204:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388668672:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748461.874312:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748461.879108:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.879282:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368705920 00000100:00100000:0.0:1788748461.879293:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368705920 00010000:00010000:0.0:1788748461.879380:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 22 pid: 8447 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748461.879414:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:0.0:1788748461.879423:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:2410:x1875638368705920:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748461.879437:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748461.879444:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 22 pid: 8447 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.879698:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 22 pid: 8447 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.879722:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748461.879729:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.879739:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.879747:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.879771:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.879793:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748461.879859:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:2410:x1875638368705920:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 437us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748461.879867:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00010000:00010000:3.0:1788748461.880459:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1ae91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ee7 expref: 21 pid: 8447 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.880479:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388668672:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748461.880501:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.880511:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.880516:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.880689:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.880701:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.880709:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.880739:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.880751:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 21 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748461.880766:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388668800:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748461.880862:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b21300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748461.890460:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.890503:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.890589:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.890622:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.890649:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.890703:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368706048 00000100:00100000:3.0:1788748461.890713:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368706048 00000100:00100000:3.0:1788748461.890759:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 388 00000100:00100000:3.0:1788748461.890769:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368706048:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748461.890852:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368706048:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.890859:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 388 00000100:00100000:0.0:1788748461.891881:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368706304 00000100:00100000:0.0:1788748461.891889:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368706304 00000100:00100000:0.0:1788748461.891961:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:0.0:1788748461.891970:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368706304:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748461.892024:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368706304:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 56us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748461.892031:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00080000:0.0:1788748461.892048:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748461.893721:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388668800:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748461.893749:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.893786:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.893804:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368706688 00000100:00100000:2.0:1788748461.893809:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368706688 00010000:00010000:2.0:1788748461.893849:0:9515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 22 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.893882:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:2.0:1788748461.893890:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:2411:x1875638368706688:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748461.893902:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748461.893909:0:9515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 22 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.893920:0:9515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 22 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.893940:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77e00/0x9ba0f20a02e1af5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f26 expref: 22 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.893976:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:2.0:1788748461.893980:0:9515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.893989:0:9515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.893997:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.894018:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748461.894059:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:2411:x1875638368706688:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 169us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.894066:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00010000:00010000:2.0:1788748461.894087:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.894094:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748461.894211:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788748461.894363:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788748461.894414:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788748461.894496:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388668928:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788748461.894541:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748461.894571:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748461.894845:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368706176 00000100:00100000:1.0:1788748461.894852:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368706176 00000100:00100000:1.0:1788748461.894909:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368706432 00000100:00100000:1.0:1788748461.894913:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368706432 00000100:00100000:1.0:1788748461.894928:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368706560 00000100:00100000:1.0:1788748461.894940:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368706560 00000100:00100000:1.0:1788748461.894960:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 315 00000100:00100000:1.0:1788748461.894968:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368706176:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:2.0:1788748461.895011:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748461.895017:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368706176:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 48us (4576us total) trans 0 rc 0/0 00000100:00080000:2.0:1788748461.895018:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788748461.895027:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 315 00000100:00100000:1.0:1788748461.895043:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 316 00000100:00100000:1.0:1788748461.895049:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368706432:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748461.895073:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368706432:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (4570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748461.895079:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 316 00000100:00100000:1.0:1788748461.895091:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 317 00000100:00100000:1.0:1788748461.895097:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368706560:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748461.895122:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368706560:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (4472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748461.895128:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 317 00000100:00100000:3.0:1788748461.895707:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388668928 00000100:00100000:3.0:1788748461.895714:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388668928 00000100:00100000:3.0:1788748461.895756:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788748461.895764:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1875638388668928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788748461.896936:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1875638388668928:12345-0@lo:1000:mdt00_002.0 Request processed in 1166us (2388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748461.896947:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788748461.897739:0:6512:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788748461.897756:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788748461.897789:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc849ab800, transno 4294967322 00000100:00100000:2.0:1788748461.897804:0:6512:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8adc849ab100 x1875638388667904/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788748477 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748461.897816:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388668928:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788748461.897983:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788748461.898054:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388669056:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788748461.898106:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748461.898516:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748461.898730:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388669056 00000100:00100000:3.0:1788748461.898738:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388669056 00000100:00100000:3.0:1788748461.898789:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788748461.898798:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1875638388669056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788748461.899108:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6512:x1875638388669056:12345-0@lo:1000:mdt00_002.0 Request processed in 311us (1000us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788748461.899200:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788748461.899708:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875638388669056:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788748461.899756:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.899767:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.899775:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.899781:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.899785:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.899793:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.899808:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:2.0:1788748461.899811:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748461.899816:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.899834:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77800/0x9ba0f20a02e1afa9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900031:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900039:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900045:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900050:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.900053:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900059:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900069:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748461.900071:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748461.900077:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900088:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900098:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.900587:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.900602:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388669184:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788748461.900737:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748461.911309:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748461.912132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368706816 00000100:00100000:1.0:1788748461.912143:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368706816 00000100:00100000:1.0:1788748461.912203:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1788748461.912212:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:12469:x1875638368706816:12345-192.168.203.22@tcp:49:lfs.0 00000100:00100000:1.0:1788748461.912367:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+25:12469:x1875638368706816:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 155us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748461.912375:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788748461.914273:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875638388669184:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788748461.914439:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.914515:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941600/0x9ba0f20a02e1aeec lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914616:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914646:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914658:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914670:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914677:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914694:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748461.914704:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914711:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914722:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:1.0:1788748461.914725:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748461.914729:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914736:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1afb0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914745:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914757:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914763:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914769:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748461.914772:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914778:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914786:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:1.0:1788748461.914789:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748461.914792:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.914798:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d76000/0x9ba0f20a02e1afa2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748461.915190:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:12470:x1875638368705792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 41169us (41337us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788748461.915200:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 246 00000020:00080000:1.0:1788748461.915205:0:6512:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788748461.918038:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748461.918048:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788748461.918735:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748461.918772:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.918986:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368707328 00000100:00100000:0.0:1788748461.918995:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368707328 00000100:00100000:0.0:1788748461.919050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1788748461.919059:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7038c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+24:12470:x1875638368707328:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788748461.919309:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788748461.919389:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1788748461.919422:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.919439:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.919710:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.919721:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.919728:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.919735:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748461.919754:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788748461.919850:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7038c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+26:12470:x1875638368707328:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 790us (1074us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788748461.919858:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000020:00080000:0.0:1788748461.919862:0:6514:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788748461.920416:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748461.920424:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.920440:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940a00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748461.920444:0:7918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.920462:0:7918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.920476:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:3.0:1788748461.920480:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788748461.920484:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.920490:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940a00/0x9ba0f20a02e1afb7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748461.920504:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748461.920506:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748461.920508:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748461.920909:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368707072 00000100:00100000:1.0:1788748461.920917:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368707072 00000100:00100000:1.0:1788748461.920974:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 247 00000100:00100000:1.0:1788748461.920984:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+26:12469:x1875638368707072:12345-192.168.203.22@tcp:58:lfs.0 00000040:00080000:1.0:1788748461.921150:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788748461.921216:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+26:12469:x1875638368707072:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 233us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748461.921223:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 247 00000040:00080000:2.0:1788748461.922786:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788748461.922803:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748461.960539:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748461.960814:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368707456 00000100:00100000:2.0:1788748461.960834:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368707456 00000100:00100000:2.0:1788748461.960903:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:2.0:1788748461.960914:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+26:12472:x1875638368707456:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748461.960939:0:10244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748461.960961:0:10244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1afbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f42 expref: -99 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961026:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961224:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961240:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961273:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961282:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961288:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961552:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961566:0:10244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961717:0:10244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961754:0:10244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.961771:0:10244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 27 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.961786:0:10244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388669312:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748461.962225:0:10244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748461.971197:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748461.971562:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368707712 00000100:00100000:0.0:1788748461.971573:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368707712 00000100:00100000:0.0:1788748461.971638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:0.0:1788748461.971648:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+28:6181:x1875638368707712:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788748461.971877:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:6181:x1875638368707712:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 230us (688us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788748461.971885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1788748461.976475:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748461.976579:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368707840 00000100:00100000:1.0:1788748461.976589:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368707840 00010000:00010000:1.0:1788748461.976630:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 29 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748461.976691:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:1.0:1788748461.976701:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:2410:x1875638368707840:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748461.976715:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748461.976722:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 29 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.976736:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 29 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.976760:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:1.0:1788748461.976765:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.976776:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.976785:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748461.976825:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748461.976880:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:2410:x1875638368707840:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 181us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748461.976900:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00010000:00010000:2.0:1788748461.976968:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1aede lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f03 expref: 28 pid: 6510 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748461.977523:0:10244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10244:1875638388669312:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788748461.977545:0:10244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977553:0:10244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977559:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748461.977610:0:10244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788748461.977614:0:10244:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748461.977636:0:10244:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977649:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977660:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977666:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977724:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977731:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bdc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.977734:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977753:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977764:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748461.977767:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.977771:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977778:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bdc00/0x9ba0f20a02e1afc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977799:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977805:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977810:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977814:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc200 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748461.977825:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977831:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977838:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8adc82598200) 00010000:00010000:2.0:1788748461.977841:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748461.977844:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977858:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc200/0x9ba0f20a02e1afcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977896:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc400/0x9ba0f20a02e1afbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f42 expref: 28 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977909:0:10244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f42 expref: 27 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748461.977916:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748461.977918:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748461.977920:0:10244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc800, rc 0) 00000100:00100000:2.0:1788748461.979367:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12472:x1875638368707456:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 18447us (18829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748461.979379:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 248 00010000:00010000:3.0:1788748462.442090:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748462.858464:0:14749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748462.858474:0:14749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748462.858507:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788748462.858513:0:14749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788748462.889823:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388669440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748462.890027:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748462.890408:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388669440 00000100:00100000:0.0:1788748462.890416:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388669440 00000100:00100000:0.0:1788748462.890495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788748462.890504:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388669440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748462.890536:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788748462.890586:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388669440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748462.890592:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788748462.890681:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388669440:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788748462.950477:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788748462.950488:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748462.950513:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788748462.950521:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788748462.950640:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388669568:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748462.950746:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb533b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748462.962931:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875638388669568:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788748462.970935:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748462.971009:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368707968 00000100:00100000:3.0:1788748462.971019:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368707968 00000100:00100000:3.0:1788748462.971075:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 249 00000100:00100000:3.0:1788748462.971084:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12484:x1875638368707968:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788748462.971121:0:6512:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788748462.971240:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12484:x1875638368707968:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 156us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748462.971260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 249 00000100:00100000:0.0:1788748462.993720:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748462.993794:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368708224 00000100:00100000:2.0:1788748462.993804:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368708224 00000100:00100000:2.0:1788748462.993861:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:2.0:1788748462.993871:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+27:12484:x1875638368708224:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788748462.993901:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748462.993930:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f49 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748462.994040:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1afe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748462.994055:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1afe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748462.994067:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1afe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748462.994079:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788748462.994190:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f49 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748462.994206:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1afe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f49 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748462.994215:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748462.994230:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748462.994233:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc000, rc 0) 00000100:00100000:2.0:1788748462.994289:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:12484:x1875638368708224:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 420us (579us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788748462.994297:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:1.0:1788748463.023688:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748463.023777:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748463.023807:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368708608 00000100:00100000:1.0:1788748463.023816:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368708608 00000100:00100000:1.0:1788748463.023873:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1788748463.023893:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:2411:x1875638368708608:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748463.023908:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748463.023932:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc000/0x9ba0f20a02e1afe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f49 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748463.023949:0:9515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:1.0:1788748463.023954:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748463.024003:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+28:2411:x1875638368708608:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 122us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748463.024011:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00080000:1.0:1788748463.024033:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748463.025705:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368708480 00000100:00100000:2.0:1788748463.025717:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368708480 00000100:00100000:2.0:1788748463.025784:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 251 00000100:00100000:2.0:1788748463.025794:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+28:12484:x1875638368708480:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788748463.025879:0:10244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.025895:0:10244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.025907:0:10244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.026047:0:10244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.026056:0:10244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.026063:0:10244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.026069:0:10244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748463.026073:0:10244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.026081:0:10244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.026106:0:10244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748463.026110:0:10244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748463.026115:0:10244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748463.026120:0:10244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd800/0x9ba0f20a02e1afef lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10244 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748463.026300:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:12484:x1875638368708480:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 506us (2628us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788748463.026308:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 251 00000040:00080000:1.0:1788748463.026840:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748463.026845:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748463.030435:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788748463.030474:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748463.033275:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748463.033408:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368708864 00000100:00100000:0.0:1788748463.033419:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368708864 00000100:00100000:0.0:1788748463.033483:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1788748463.033494:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+29:12484:x1875638368708864:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788748463.033723:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:12484:x1875638368708864:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 230us (456us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788748463.033731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00010000:00010000:1.0:1788748463.460795:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748464.487582:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748464.933148:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748464.933169:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388669696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748464.933247:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748464.933367:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388669696 00000100:00100000:3.0:1788748464.933374:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388669696 00000100:00100000:3.0:1788748464.933417:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788748464.933425:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388669696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788748464.933453:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788748464.933496:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388669696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748464.933513:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788748464.933557:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388669696:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788748465.063359:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748465.063370:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748465.063395:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788748465.063416:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788748465.068405:0:14801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788748465.068416:0:14801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748465.068457:0:14801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788748465.068463:0:14801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748465.264092:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748465.269290:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368709120 00000100:00100000:2.0:1788748465.269311:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368709120 00000100:00100000:2.0:1788748465.269645:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 252 00000100:00100000:2.0:1788748465.269671:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+30:12505:x1875638368709120:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748465.269704:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748465.269733:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aff6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f50 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788748465.269917:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788748465.270104:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1affd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748465.270123:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1affd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748465.270141:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1affd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748465.270156:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788748465.270579:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bca00/0x9ba0f20a02e1aff6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f50 expref: 33 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748465.270604:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1affd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f50 expref: 32 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748465.270615:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748465.270637:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788748465.270641:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd000, rc 0) 00000100:00100000:2.0:1788748465.270782:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:12505:x1875638368709120:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1125us (6702us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788748465.270791:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 252 00000100:00100000:2.0:1788748465.283079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748465.283158:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368709248 00000100:00100000:0.0:1788748465.283172:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368709248 00000100:00100000:0.0:1788748465.283264:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 253 00000100:00100000:0.0:1788748465.283276:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:12505:x1875638368709248:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788748465.283509:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283533:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283547:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283594:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283602:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283610:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283617:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940800 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748465.283622:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283631:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283645:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:0.0:1788748465.283672:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748465.283680:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.283688:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b00b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748465.283780:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:12505:x1875638368709248:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 506us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748465.283789:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 253 00000100:00100000:3.0:1788748465.417589:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748465.419482:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368709376 00000100:00100000:0.0:1788748465.419501:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368709376 00000100:00100000:0.0:1788748465.419604:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1788748465.419616:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2411:x1875638368709376:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1788748465.419641:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748465.419680:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b012 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f57 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748465.419713:0:8734:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9e22ad, atime: 0x6a9e22ac, ctime: 0x6a9e22ad, blocks: 0x8 00010000:00010000:0.0:1788748465.419740:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788748465.419745:0:8734:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748465.419756:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f57 expref: 8 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.419779:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f57 expref: 8 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748465.419796:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748465.419892:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368709376:12345-192.168.203.22@tcp:101:cat.0 Request processed in 278us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748465.419900:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00080000:0.0:1788748465.419935:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748465.426701:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748465.426750:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368709504 00000100:00100000:3.0:1788748465.426762:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368709504 00002000:00100000:3.0:1788748465.426830:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8adc849aa300 x1875638368709504/t0(0) o3->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:211/0 lens 488/0 e 0 to 0 dl 1788748476 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748465.426842:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc849aa300 with x1875638368709504 ext(0->4095) 00002000:00010000:3.0:1788748465.426849:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc849aa300 00000100:00100000:3.0:1788748465.426883:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1788748465.426894:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368709504:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:3.0:1788748465.427112:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2410:x1875638368709504:12345-192.168.203.22@tcp:3:cat.0 Request processed in 220us (424us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788748465.427138:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00002000:00100000:3.0:1788748465.427146:0:8431:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8adc849aa300 x1875638368709504/t0(0) o3->53dfbad0-5125-4663-8fa7-3e1aae0338a8@192.168.203.22@tcp:211/0 lens 488/4536 e 0 to 0 dl 1788748476 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788748465.427155:0:8431:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff8adc849aa300 with x1875638368709504 ext(0->4095) 00002000:00010000:3.0:1788748465.427159:0:8431:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8adc849aa300 00000100:00100000:3.0:1788748465.444897:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388670208:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.444985:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445066:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388670720:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445090:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445115:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388671232:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445138:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445166:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788748465.445172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388669824:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445204:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445227:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388670464:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445270:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388670848:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445291:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445307:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388671360:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445354:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445382:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388669952:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445426:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388670336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748465.445469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445486:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388670976:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445505:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445526:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388671488:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445547:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445566:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788748465.445572:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388670080:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445608:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445642:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.445671:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445721:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388671616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748465.445752:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.445789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670208 00000100:00100000:3.0:1788748465.445797:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670208 00000100:00100000:3.0:1788748465.445842:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670720 00000100:00100000:3.0:1788748465.445846:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670720 00000100:00100000:3.0:1788748465.445876:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388671232 00000100:00100000:3.0:1788748465.445879:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388671232 00000100:00100000:3.0:1788748465.445894:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388669952 00000100:00100000:3.0:1788748465.445896:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388669952 00000100:00100000:3.0:1788748465.445909:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670592 00000100:00100000:3.0:1788748465.445912:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670592 00000100:00100000:3.0:1788748465.445927:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388671104 00000100:00100000:3.0:1788748465.445930:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388671104 00000100:00100000:3.0:1788748465.445949:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788748465.445962:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388670208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446034:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388670208:12345-0@lo:400:kworker.0 Request processed in 76us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446042:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788748465.446062:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788748465.446067:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388670720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446090:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388670720:12345-0@lo:400:kworker.0 Request processed in 24us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446096:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788748465.446105:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788748465.446110:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388671232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446135:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388671232:12345-0@lo:400:kworker.0 Request processed in 24us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446142:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788748465.446155:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788748465.446161:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388669952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446193:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388669952:12345-0@lo:400:kworker.0 Request processed in 32us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788748465.446214:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788748465.446220:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388670592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446250:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388670592:12345-0@lo:400:kworker.0 Request processed in 30us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446256:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788748465.446267:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788748465.446273:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388671104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446311:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388671104:12345-0@lo:400:kworker.0 Request processed in 39us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446353:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788748465.446383:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388669824 00000100:00100000:3.0:1788748465.446387:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388669824 00000100:00100000:3.0:1788748465.446416:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788748465.446423:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388669824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446455:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388669824:12345-0@lo:400:kworker.0 Request processed in 32us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446461:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788748465.446492:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670464 00000100:00100000:3.0:1788748465.446496:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670464 00000100:00100000:3.0:1788748465.446518:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670080 00000100:00100000:3.0:1788748465.446521:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670080 00000100:00100000:3.0:1788748465.446532:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788748465.446538:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388670464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446572:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388670464:12345-0@lo:400:kworker.0 Request processed in 33us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446579:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788748465.446590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788748465.446595:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388670080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446625:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388670080:12345-0@lo:400:kworker.0 Request processed in 29us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446630:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788748465.446649:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670848 00000100:00100000:3.0:1788748465.446653:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670848 00000100:00100000:3.0:1788748465.446687:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388671360 00000100:00100000:3.0:1788748465.446697:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388671360 00000100:00100000:3.0:1788748465.446714:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670976 00000100:00100000:3.0:1788748465.446717:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670976 00000100:00100000:3.0:1788748465.446728:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388671488 00000100:00100000:3.0:1788748465.446731:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388671488 00000100:00100000:3.0:1788748465.446744:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788748465.446749:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388670848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446782:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388670848:12345-0@lo:400:kworker.0 Request processed in 33us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446787:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788748465.446799:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788748465.446805:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388671360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446838:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388671360:12345-0@lo:400:kworker.0 Request processed in 33us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446845:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788748465.446856:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788748465.446862:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388670976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446886:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388670976:12345-0@lo:400:kworker.0 Request processed in 25us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446891:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788748465.446899:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788748465.446904:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388671488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.446925:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1875638388671488:12345-0@lo:400:kworker.0 Request processed in 21us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.446930:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788748465.446961:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388670336 00000100:00100000:3.0:1788748465.446965:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388670336 00000100:00100000:3.0:1788748465.446999:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388671616 00000100:00100000:3.0:1788748465.447003:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388671616 00000100:00100000:3.0:1788748465.447016:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788748465.447023:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388670336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748465.447053:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748465.447091:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388670336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.447099:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788748465.447112:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788748465.447118:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb55ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875638388671616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748465.447126:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748465.447152:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb55ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875638388671616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.447158:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788748465.447440:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748465.447445:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748465.447448:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748465.447451:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748465.447512:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388671616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748465.447555:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388670080:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.447568:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.447580:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.447593:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388669952:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.447608:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388670336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748465.447635:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388670976:0@lo:400:kworker.0 00000100:00100000:3.0:1788748465.447644:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388671488:0@lo:400:kworker.0 00000100:00100000:2.0:1788748465.453676:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388669824:0@lo:400:kworker.0 00000100:00100000:2.0:1788748465.453706:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388670464:0@lo:400:kworker.0 00000100:00100000:2.0:1788748465.453723:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388670848:0@lo:400:kworker.0 00000100:00100000:2.0:1788748465.453737:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388671360:0@lo:400:kworker.0 00000100:00100000:2.0:1788748465.453750:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388670208:0@lo:400:kworker.0 00010000:00080000:2.0:1788748465.453767:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f160380 x1875638388670720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748465.453778:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388670720:0@lo:400:kworker.0 00010000:00080000:2.0:1788748465.453790:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f163100 x1875638388671232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748465.453797:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388671232:0@lo:400:kworker.0 00000040:00080000:2.0:1788748465.509220:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788748465.512702:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748465.956675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748465.956706:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388671744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748465.956806:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748465.957018:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388671744 00000100:00100000:3.0:1788748465.957029:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388671744 00000100:00100000:3.0:1788748465.957100:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788748465.957112:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388671744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748465.957149:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788748465.957211:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388671744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748465.957218:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788748465.957277:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388671744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748465.957530:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388671872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748465.957564:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748465.957716:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388671872 00000100:00100000:2.0:1788748465.957723:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388671872 00000100:00100000:2.0:1788748465.957762:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788748465.957771:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388671872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748465.957786:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788748465.957845:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875638388671872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748465.957852:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788748465.957886:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388671872:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788748465.963859:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788748465.963896:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:1.0:1788748466.532623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748467.009595:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748467.009634:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748467.009667:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748467.009683:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748467.009696:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748467.009712:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748467.009731:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748467.009759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368709888 00000100:00100000:3.0:1788748467.009768:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368709888 00000100:00100000:3.0:1788748467.009819:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368710400 00000100:00100000:3.0:1788748467.009822:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368710400 00000100:00100000:3.0:1788748467.009835:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368709760 00000100:00100000:3.0:1788748467.009849:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368709760 00000100:00100000:3.0:1788748467.009864:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368710272 00000100:00100000:3.0:1788748467.009866:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368710272 00000100:00100000:3.0:1788748467.009881:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 324 00000100:00100000:3.0:1788748467.009890:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368709888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748467.009962:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368709888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 72us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748467.009968:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 324 00000100:00100000:3.0:1788748467.009985:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 325 00000100:00100000:3.0:1788748467.009992:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368710400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748467.010013:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368710400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748467.010018:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 325 00000100:00100000:3.0:1788748467.010029:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 326 00000100:00100000:3.0:1788748467.010034:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:2411:x1875638368709760:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748467.010056:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+32:2411:x1875638368709760:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748467.010062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 326 00000100:00100000:3.0:1788748467.010072:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 327 00000100:00100000:3.0:1788748467.010078:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368710272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748467.010102:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2411:x1875638368710272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748467.010107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 327 00000100:00100000:3.0:1788748467.010125:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368710144 00000100:00100000:3.0:1788748467.010134:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368710144 00000100:00100000:3.0:1788748467.010160:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368710016 00000100:00100000:3.0:1788748467.010163:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368710016 00000100:00100000:3.0:1788748467.010180:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1788748467.010186:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368710144:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748467.010210:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2411:x1875638368710144:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748467.010215:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1788748467.010225:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:3.0:1788748467.010230:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368710016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748467.010249:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+8:2411:x1875638368710016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 19us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748467.010254:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00080000:3.0:1788748467.010278:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748467.010281:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748467.010284:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748467.010286:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748467.010621:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368709632 00000100:00100000:2.0:1788748467.010626:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368709632 00000100:00100000:2.0:1788748467.010674:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 390 00000100:00100000:2.0:1788748467.010681:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368709632:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748467.010712:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368709632:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 32us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748467.010718:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 390 00010000:00010000:3.0:1788748467.556524:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748468.005924:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388672000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748468.006004:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748468.006274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672000 00000100:00100000:2.0:1788748468.006282:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672000 00000100:00100000:2.0:1788748468.006357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788748468.006368:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388672000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748468.006402:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788748468.006466:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388672000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748468.006473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788748468.006573:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388672000:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788748468.008439:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788748468.008479:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8addb533bcc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788748468.008483:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc84843c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8addb533b300 00000020:00080000:1.0:1788748468.008487:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8adc84843a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8adc84a1aa00 00000020:00080000:1.0:1788748468.008514:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788748468.008536:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788748468.008619:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788748468.008787:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748468.008798:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748468.008806:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748468.008811:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748468.008816:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748468.008823:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748468.008839:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8adda17e1400) 00010000:00010000:0.0:1788748468.008843:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748468.008847:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748468.008853:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd600/0x9ba0f20a02e1af8d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748468.009080:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1788748468.009087:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:2.0:1788748468.586694:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748469.607679:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748470.060165:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388672128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748470.060240:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748470.063098:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672128 00000100:00100000:0.0:1788748470.063122:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672128 00000100:00100000:2.0:1788748470.063248:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788748470.063259:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388672128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748470.063302:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748470.063426:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388672128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.063434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788748470.063528:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388672128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748470.565895:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388672256:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.565979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748470.566030:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388672768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.566059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748470.566078:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388673280:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.566102:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748470.566136:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788748470.567083:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388672640:0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.567133:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748470.567159:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388673152:0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.567183:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748470.567200:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388673664:0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.567220:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748470.567242:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788748470.567248:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388672512:0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.567271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748470.567289:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388673024:0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.567342:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748470.567360:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388673536:0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.567381:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748470.567443:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672768 00000100:00100000:0.0:1788748470.567450:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672768 00000100:00100000:0.0:1788748470.567501:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673280 00000100:00100000:0.0:1788748470.567504:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673280 00000100:00100000:0.0:1788748470.567524:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672640 00000100:00100000:0.0:1788748470.567527:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672640 00000100:00100000:0.0:1788748470.567543:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788748470.567551:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388672768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.567605:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388672768:12345-0@lo:400:kworker.0 Request processed in 54us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748470.567612:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788748470.567975:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388672384:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.568005:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748470.568021:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388672896:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.568038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748470.568048:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388673408:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.568064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748470.568090:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388672768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.568117:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673152 00000100:00100000:3.0:1788748470.568120:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673152 00000100:00100000:2.0:1788748470.568289:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748470.568299:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388673792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748470.568346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748470.568373:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673664 00000100:00100000:2.0:1788748470.568376:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673664 00000100:00100000:2.0:1788748470.568409:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673024 00000100:00100000:2.0:1788748470.568413:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673024 00000100:00100000:2.0:1788748470.568427:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673536 00000100:00100000:2.0:1788748470.568429:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673536 00000100:00100000:2.0:1788748470.568444:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788748470.568452:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388673152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.568495:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388673152:12345-0@lo:400:kworker.0 Request processed in 45us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.568501:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788748470.568517:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788748470.568523:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388673664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.568551:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388673664:12345-0@lo:400:kworker.0 Request processed in 28us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.568557:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788748470.568568:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788748470.568574:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbcacf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388673024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.568602:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbcacf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388673024:12345-0@lo:400:kworker.0 Request processed in 29us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.568617:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788748470.568784:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788748470.568791:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388673536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.568820:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388673536:12345-0@lo:400:kworker.0 Request processed in 30us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.568825:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788748470.569931:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672512 00000100:00100000:3.0:1788748470.569940:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672512 00000100:00100000:3.0:1788748470.569978:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788748470.569986:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388672512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.570043:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388672512:12345-0@lo:400:kworker.0 Request processed in 59us (2771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748470.570049:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1788748470.570068:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748470.570072:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748470.570075:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748470.570085:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672384 00000100:00100000:3.0:1788748470.570089:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672384 00000100:00100000:0.0:1788748470.570179:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672896 00000100:00100000:0.0:1788748470.570183:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672896 00000100:00100000:2.0:1788748470.571243:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673792 00000100:00100000:2.0:1788748470.571251:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673792 00000100:00100000:2.0:1788748470.571301:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788748470.571310:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388673792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748470.571347:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788748470.571404:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388673792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.571410:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788748470.571520:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388673920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748470.571556:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748470.571603:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388673792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748470.571656:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388672512:0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.571668:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388673024:0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.571677:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388673536:0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.571687:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788748470.571692:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc849ab100, transno 4294967323 00000004:00080000:2.0:1788748470.571708:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788748470.571732:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388673152:0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.571745:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788748470.571748:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788748470.571766:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc84a46300, transno 4294967311 00000100:00100000:2.0:1788748470.571779:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388673664:0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.571954:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673408 00000100:00100000:2.0:1788748470.571960:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673408 00000100:00100000:3.0:1788748470.572393:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788748470.572404:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388673280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.572462:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388673280:12345-0@lo:400:kworker.0 Request processed in 61us (6358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748470.572469:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788748470.572493:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788748470.572499:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388672640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.572539:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388672640:12345-0@lo:400:kworker.0 Request processed in 40us (5406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748470.572545:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788748470.572558:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788748470.574988:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388672384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.575088:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388672384:12345-0@lo:400:kworker.0 Request processed in 99us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748470.575096:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:3.0:1788748470.575136:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748470.575163:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388673920 00000100:00100000:3.0:1788748470.575171:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388673920 00000100:00100000:3.0:1788748470.575205:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788748470.575212:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388673920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788748470.575227:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748470.575266:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388673920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748470.575273:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788748470.575312:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388672384:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.575346:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388673280:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.575381:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388672640:0@lo:400:kworker.0 00000100:00100000:3.0:1788748470.575416:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388673920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748470.576201:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388672256 00000100:00100000:1.0:1788748470.576207:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388672256 00000100:00100000:1.0:1788748470.576248:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788748470.576256:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388672256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748470.576340:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3637:x1875638388672256:12345-0@lo:400:kworker.0 Request processed in 62us (10336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748470.576347:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788748470.576406:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388672256:0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.583845:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788748470.583867:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388672896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748470.583973:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388672896:12345-0@lo:400:kworker.0 Request processed in 116us (15933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748470.583982:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788748470.584126:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788748470.584147:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388673408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748470.584186:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388673408:12345-0@lo:400:kworker.0 Request processed in 52us (16120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.584191:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00080000:1.0:1788748470.588730:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f162300 x1875638388672896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748470.588750:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388672896:0@lo:400:kworker.0 00010000:00080000:1.0:1788748470.588766:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f161500 x1875638388673408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748470.588775:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388673408:0@lo:400:kworker.0 00010000:00010000:2.0:1788748470.632768:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748470.928453:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748470.928578:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368710528 00000100:00100000:1.0:1788748470.928594:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368710528 00000100:00100000:1.0:1788748470.928702:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 254 00000100:00100000:1.0:1788748470.928714:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:12149:x1875638368710528:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788748470.928988:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:12149:x1875638368710528:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 275us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748470.928996:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 254 00000100:00080000:3.0:1788748470.929520:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748470.938385:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748470.942327:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368710656 00000100:00100000:2.0:1788748470.942343:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368710656 00000100:00100000:2.0:1788748470.942488:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 255 00000100:00100000:2.0:1788748470.942499:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:12149:x1875638368710656:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788748470.942626:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:12149:x1875638368710656:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 121us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748470.942634:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 255 00000100:00080000:3.0:1788748470.945669:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748470.945853:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748470.946001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368710912 00000100:00100000:1.0:1788748470.946011:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368710912 00000100:00100000:1.0:1788748470.946059:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:1.0:1788748470.946068:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:12149:x1875638368710912:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788748470.946520:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:12149:x1875638368710912:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 451us (670us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788748470.946528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:0.0:1788748471.078912:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388674048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788748471.078990:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748471.079727:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748471.079739:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388674176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748471.079780:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748471.079889:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674048 00000100:00100000:2.0:1788748471.079897:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674048 00000100:00100000:2.0:1788748471.079947:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674176 00000100:00100000:2.0:1788748471.079950:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674176 00000100:00100000:2.0:1788748471.079966:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788748471.079975:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388674048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748471.080010:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788748471.080056:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388674048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748471.080064:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788748471.080080:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788748471.080086:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388674176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748471.080094:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788748471.080118:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388674176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748471.080123:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788748471.080268:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388674176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748471.080296:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388674048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788748471.658846:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748472.118311:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748472.118418:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748472.118462:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748472.118504:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748472.118525:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748472.118549:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748472.118573:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748472.118618:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711296 00000100:00100000:1.0:1788748472.118631:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711296 00000100:00100000:1.0:1788748472.118708:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711808 00000100:00100000:1.0:1788748472.118712:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711808 00000100:00100000:1.0:1788748472.118727:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711168 00000100:00100000:1.0:1788748472.118729:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711168 00000100:00100000:1.0:1788748472.118742:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711680 00000100:00100000:1.0:1788748472.118744:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711680 00000100:00100000:1.0:1788748472.118764:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 334 00000100:00100000:1.0:1788748472.118775:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368711296:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748472.118874:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368711296:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 101us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748472.118882:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 334 00000100:00100000:1.0:1788748472.118920:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 335 00000100:00100000:1.0:1788748472.118928:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368711808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748472.118957:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368711808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748472.118964:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 335 00000100:00100000:1.0:1788748472.119003:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 336 00000100:00100000:1.0:1788748472.119010:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:2410:x1875638368711168:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748472.119049:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:2410:x1875638368711168:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748472.119056:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 336 00000100:00100000:1.0:1788748472.119068:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 337 00000100:00100000:1.0:1788748472.119074:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368711680:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748472.119099:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368711680:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748472.119106:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 337 00000100:00100000:0.0:1788748472.119221:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711552 00000100:00100000:0.0:1788748472.119226:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711552 00000100:00100000:0.0:1788748472.119268:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711424 00000100:00100000:0.0:1788748472.119271:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711424 00000100:00100000:0.0:1788748472.119295:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:0.0:1788748472.119302:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368711552:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748472.119364:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368711552:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 63us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748472.119371:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:0.0:1788748472.119386:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:0.0:1788748472.119392:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368711424:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748472.119419:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368711424:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748472.119425:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00080000:3.0:1788748472.119702:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748472.119708:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748472.119711:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748472.119715:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748472.119919:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711040 00000100:00100000:2.0:1788748472.119926:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711040 00000100:00100000:2.0:1788748472.119975:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 392 00000100:00100000:2.0:1788748472.119984:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368711040:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748472.120019:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2410:x1875638368711040:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 37us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748472.120026:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 392 00010000:00010000:1.0:1788748472.679759:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748472.987251:0:14998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:34:32 (1788748472) 00000100:00100000:1.0:1788748473.126814:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388674304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748473.126888:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748473.127260:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674304 00000100:00100000:2.0:1788748473.127269:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674304 00000100:00100000:2.0:1788748473.127347:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788748473.127357:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388674304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748473.127732:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788748473.128557:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388674304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1199us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748473.128575:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788748473.128595:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388674304:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788748473.704911:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788748474.179480:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788748474.179508:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788748474.179533:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788748474.179543:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788748474.725331:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748475.176733:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388674432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748475.176853:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748475.177135:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674432 00000100:00100000:2.0:1788748475.177144:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674432 00000100:00100000:2.0:1788748475.177210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788748475.177220:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388674432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748475.177254:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748475.177356:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388674432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748475.177364:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788748475.177381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388674432:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788748475.300840:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788748475.300850:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788748475.300957:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788748475.300977:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788748475.332809:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748475.334765:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368711936 00000100:00100000:1.0:1788748475.334781:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368711936 00000100:00100000:1.0:1788748475.334872:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 256 00000100:00100000:1.0:1788748475.334884:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:13179:x1875638368711936:12345-192.168.203.22@tcp:101:lsof.0 00010000:00010000:1.0:1788748475.334903:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748475.334926:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1b019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f5e expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788748475.335048:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788748475.335070:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748475.335086:0:8447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748475.335100:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748475.335145:0:8447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788748475.335149:0:8447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748475.335192:0:8447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748475.335216:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69c00/0x9ba0f20a02e1b019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f5e expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748475.335235:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f5e expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748475.335244:0:8447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:1.0:1788748475.335247:0:8447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748475.335250:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69200, rc 0) 00000100:00100000:1.0:1788748475.335368:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:13179:x1875638368711936:12345-192.168.203.22@tcp:101:lsof.0 Request processed in 487us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748475.335376:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 256 00000100:00100000:0.0:1788748475.684732:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788748475.684769:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388674560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748475.684838:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748475.684972:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674560 00000100:00100000:1.0:1788748475.684980:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674560 00000100:00100000:1.0:1788748475.685057:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788748475.685071:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388674560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748475.685103:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748475.685162:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388674560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748475.685169:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788748475.685231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388674560:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788748475.685304:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748475.685876:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388674816:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.685916:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748475.685949:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388675328:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.685969:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748475.685988:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388675840:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686007:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748475.686026:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788748475.686031:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388674944:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748475.686070:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388675456:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686091:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748475.686108:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388675968:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686126:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748475.686149:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674816 00000100:00100000:2.0:1788748475.686154:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674816 00000100:00100000:2.0:1788748475.686186:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675328 00000100:00100000:2.0:1788748475.686209:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675328 00000100:00100000:2.0:1788748475.686233:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675840 00000100:00100000:2.0:1788748475.686236:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675840 00000100:00100000:2.0:1788748475.686250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788748475.686257:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388674816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686303:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388674816:12345-0@lo:400:kworker.0 Request processed in 47us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748475.686310:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788748475.686347:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788748475.686353:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388675328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686378:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388675328:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748475.686383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788748475.686393:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788748475.686398:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388675840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686420:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388675840:12345-0@lo:400:kworker.0 Request processed in 21us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748475.686425:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788748475.686444:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674944 00000100:00100000:2.0:1788748475.686448:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674944 00000100:00100000:2.0:1788748475.686468:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788748475.686474:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388674944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686503:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388674944:12345-0@lo:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748475.686509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788748475.686524:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675456 00000100:00100000:2.0:1788748475.686527:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675456 00000100:00100000:2.0:1788748475.686555:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675968 00000100:00100000:2.0:1788748475.686558:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675968 00000100:00100000:2.0:1788748475.686575:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788748475.686581:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388675456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686621:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388675456:12345-0@lo:400:kworker.0 Request processed in 41us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748475.686627:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788748475.686637:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788748475.686643:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388675968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686667:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388675968:12345-0@lo:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748475.686672:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1788748475.686692:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788748475.686695:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748475.686698:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748475.686721:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388674944:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686731:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388675456:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686739:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388675968:0@lo:400:kworker.0 00000100:00100000:2.0:1788748475.686747:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388674816:0@lo:400:kworker.0 00010000:00080000:2.0:1788748475.686757:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533f800 x1875638388675328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748475.686766:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388675328:0@lo:400:kworker.0 00010000:00080000:2.0:1788748475.686774:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8addb533fb80 x1875638388675840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748475.686782:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388675840:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687112:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388674688:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748475.687197:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388675200:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687222:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748475.687242:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388675712:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687261:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748475.687279:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788748475.687285:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388675072:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687305:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748475.687338:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388675584:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687358:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748475.687381:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675200 00000100:00100000:0.0:1788748475.687386:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675200 00000100:00100000:0.0:1788748475.687413:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675712 00000100:00100000:0.0:1788748475.687416:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675712 00000100:00100000:0.0:1788748475.687427:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675072 00000100:00100000:0.0:1788748475.687429:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675072 00000100:00100000:0.0:1788748475.687442:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788748475.687448:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388675200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687483:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388675200:12345-0@lo:400:kworker.0 Request processed in 35us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748475.687490:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788748475.687503:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788748475.687509:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388675712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687540:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388675712:12345-0@lo:400:kworker.0 Request processed in 32us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748475.687547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788748475.687558:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788748475.687564:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388675072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687597:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388675072:12345-0@lo:400:kworker.0 Request processed in 22us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748475.687603:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:0.0:1788748475.687618:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748475.687639:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388675072:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687648:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388675200:0@lo:400:kworker.0 00000100:00100000:0.0:1788748475.687656:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388675712:0@lo:400:kworker.0 00000100:00100000:3.0:1788748475.687804:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388675584 00000100:00100000:3.0:1788748475.687809:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388675584 00000100:00100000:3.0:1788748475.687855:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788748475.687861:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388675584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748475.687900:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388675584:12345-0@lo:400:kworker.0 Request processed in 40us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748475.687907:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788748475.687939:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388675584:0@lo:400:kworker.0 00000100:00100000:3.0:1788748475.688100:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388676096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748475.688127:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748475.688216:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676096 00000100:00100000:1.0:1788748475.688221:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676096 00000100:00100000:1.0:1788748475.688255:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788748475.688263:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388676096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748475.688277:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748475.688312:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388676096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748475.688345:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788748475.688468:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388676096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748475.688655:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388674688 00000100:00100000:3.0:1788748475.688668:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388674688 00000100:00100000:3.0:1788748475.688704:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788748475.688711:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388674688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748475.688749:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388674688:12345-0@lo:400:kworker.0 Request processed in 39us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748475.688756:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788748475.688787:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388674688:0@lo:400:kworker.0 00000100:00080000:0.0:1788748475.688861:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788748475.749106:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748475.749846:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748476.197068:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388676224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748476.197135:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748476.197381:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388676352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748476.197409:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748476.197591:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676224 00000100:00100000:0.0:1788748476.197600:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676224 00000100:00100000:0.0:1788748476.197648:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676352 00000100:00100000:0.0:1788748476.197651:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676352 00000100:00100000:0.0:1788748476.197668:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788748476.197676:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388676224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748476.197705:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788748476.197759:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388676224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748476.197766:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788748476.197782:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788748476.197812:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388676352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748476.197822:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788748476.197851:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388676352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748476.197856:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788748476.197989:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388676224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748476.198369:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388676352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788748476.772532:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748477.212296:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748477.212586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368712192 00000100:00100000:0.0:1788748477.212595:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368712192 00000100:00100000:0.0:1788748477.212730:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:0.0:1788748477.212741:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+18:13180:x1875638368712192:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:0.0:1788748477.213022:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:13180:x1875638368712192:12345-192.168.203.22@tcp:35:umount.0 Request processed in 282us (733us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788748477.213029:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00080000:2.0:1788748477.213343:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748477.215750:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748477.215872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368712448 00000100:00100000:1.0:1788748477.215885:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368712448 00000100:00100000:1.0:1788748477.215958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1788748477.215969:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+19:13180:x1875638368712448:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:1.0:1788748477.216422:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:13180:x1875638368712448:12345-192.168.203.22@tcp:35:umount.0 Request processed in 451us (682us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788748477.216431:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:3.0:1788748477.221426:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748477.221585:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368712704 00000100:00100000:1.0:1788748477.221611:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368712704 00000100:00100000:1.0:1788748477.221696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1788748477.221708:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adda7038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+20:13180:x1875638368712704:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:1.0:1788748477.222115:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adda7038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:13180:x1875638368712704:12345-192.168.203.22@tcp:35:umount.0 Request processed in 408us (702us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788748477.222123:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:2.0:1788748477.224659:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748477.224927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368712960 00000100:00100000:1.0:1788748477.224941:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368712960 00000100:00100000:1.0:1788748477.225008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:1.0:1788748477.225020:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:13180:x1875638368712960:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:1.0:1788748477.225467:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:13180:x1875638368712960:12345-192.168.203.22@tcp:35:umount.0 Request processed in 448us (828us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788748477.225476:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1788748477.230366:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748477.230405:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748477.230603:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713088 00000100:00100000:0.0:1788748477.230617:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713088 00000100:00100000:0.0:1788748477.230712:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713216 00000100:00100000:0.0:1788748477.230716:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713216 00000100:00100000:0.0:1788748477.230754:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1788748477.230767:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ef6cf0-4626-4079-99a4-603102db0d3e+14:2411:x1875638368713088:12345-192.168.203.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788748477.231069:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1788748477.231082:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+14:2411:x1875638368713216:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748477.231094:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748477.231119:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bba000/0x9ba0f20a02e19f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3a79 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.231139:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748477.231208:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+13:2411:x1875638368713216:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 129us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748477.231216:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00010000:00010000:0.0:1788748477.231766:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748477.231782:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f7400/0x9ba0f20a02e19f87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ab8 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748477.231851:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748477.231882:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09ef6cf0-4626-4079-99a4-603102db0d3e+11:2411:x1875638368713088:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1118us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748477.231890:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788748477.235232:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748477.235480:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748477.235569:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713344 00000100:00100000:0.0:1788748477.235609:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713344 00000100:00100000:0.0:1788748477.235698:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:0.0:1788748477.235711:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2409:x1875638368713344:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:0.0:1788748477.235753:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e1a323 00000100:00080000:0.0:1788748477.235765:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8adc838b9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748477.235834:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:1.0:1788748477.236221:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788748477.236255:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748477.238675:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748477.238989:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+2:2409:x1875638368713344:12345-192.168.203.22@tcp:9:umount.0 Request processed in 3278us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748477.239002:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1788748477.240077:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713472 00000100:00100000:2.0:1788748477.240093:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713472 00000100:00100000:2.0:1788748477.240170:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1788748477.240181:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+11:2410:x1875638368713472:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788748477.240201:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748477.240228:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76200/0x9ba0f20a02e1a258 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b91 expref: 11 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.240246:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748477.240506:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368713472:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 325us (5024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748477.240515:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1788748477.245250:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713600 00000100:00100000:1.0:1788748477.245266:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713600 00000100:00100000:1.0:1788748477.245394:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 344 00000100:00100000:1.0:1788748477.245407:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368713600:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748477.245481:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2410:x1875638368713600:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (6814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748477.245489:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 344 00000100:00080000:3.0:1788748477.247483:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748477.248496:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748477.248542:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748477.248571:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748477.248644:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713728 00000100:00100000:3.0:1788748477.248655:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713728 00000100:00100000:3.0:1788748477.248735:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1788748477.248745:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368713728:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748477.248805:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2410:x1875638368713728:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748477.248812:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00080000:3.0:1788748477.248832:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748477.248842:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713856 00000100:00100000:3.0:1788748477.248846:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713856 00000100:00100000:1.0:1788748477.249043:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368713984 00000100:00100000:1.0:1788748477.249048:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368713984 00000100:00100000:1.0:1788748477.249077:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 345 00000100:00100000:1.0:1788748477.249085:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2410:x1875638368713856:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748477.249121:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2410:x1875638368713856:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748477.249127:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 345 00000100:00100000:1.0:1788748477.249141:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 346 00000100:00100000:1.0:1788748477.249147:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368713984:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748477.249173:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2410:x1875638368713984:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748477.249180:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 346 00000100:00080000:3.0:1788748477.249454:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748477.249458:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748477.256797:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748477.257073:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368714368 00000100:00100000:0.0:1788748477.257088:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368714368 00000100:00100000:0.0:1788748477.257158:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:0.0:1788748477.257168:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+7:2409:x1875638368714368:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:0.0:1788748477.257200:0:8734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e1a599 00000020:00010000:0.0:1788748477.257210:0:8734:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8add85231800: total 0 00000100:00080000:0.0:1788748477.257215:0:8734:0:(import.c:65:import_set_state_nolock()) ffff8add852ab000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748477.257259:0:8734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:1.0:1788748477.257714:0:6499:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8add85231800: total 0 00010000:00010000:1.0:1788748477.257777:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8add85231800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788748477.257828:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1e786d0/0x9ba0f20a02e1a951 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d7b expref: 6 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748477.257861:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b012 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f57 expref: 5 pid: 8734 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748477.257874:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8add85231800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788748477.257886:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748477.257888:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748477.257890:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748477.258804:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53dfbad0-5125-4663-8fa7-3e1aae0338a8+2:2409:x1875638368714368:12345-192.168.203.22@tcp:9:umount.0 Request processed in 1631us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748477.258816:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:0.0:1788748477.278156:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748477.278478:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368715392 00000100:00100000:1.0:1788748477.278488:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368715392 00000100:00100000:1.0:1788748477.278548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 257 00000100:00100000:1.0:1788748477.278558:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+22:2409:x1875638368715392:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:1.0:1788748477.278602:0:6512:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f56 00000020:00010000:1.0:1788748477.278637:0:6512:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8addbf54e800: total 0 00000100:00080000:1.0:1788748477.278642:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8addbf54b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748477.278678:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788748477.278833:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53dfbad0-5125-4663-8fa7-3e1aae0338a8+21:2409:x1875638368715392:12345-192.168.203.22@tcp:39:umount.0 Request processed in 275us (685us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788748477.278840:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 257 00000020:00010000:2.0:1788748477.278954:0:7918:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8addbf54e800: total 0 00010000:00010000:2.0:1788748477.279006:0:7918:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8addbf54e800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788748477.279074:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8addba6a9900) 00010000:00010000:2.0:1788748477.279078:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748477.279087:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69600/0x9ba0f20a02e1a282 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b9f expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279158:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748477.279162:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748477.279169:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1aef3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f0a expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279184:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748477.279186:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748477.279190:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bce00/0x9ba0f20a02e1a832 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d2e expref: 18 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279203:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748477.279206:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788748477.279209:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd400/0x9ba0f20a02e1a9c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d97 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279220:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748477.279222:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788748477.279226:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941800/0x9ba0f20a02e1a2f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3bbb expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279238:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8addba6a8900) 00010000:00010000:2.0:1788748477.279240:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748477.279243:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc600/0x9ba0f20a02e1a5f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3c94 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279283:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748477.279287:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748477.279291:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bc800/0x9ba0f20a02e1afd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f42 expref: 14 pid: 10244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279379:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8addb5113300) 00010000:00010000:2.0:1788748477.279383:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748477.279387:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add95d77a00/0x9ba0f20a02e1a29e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3ba6 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279407:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748477.279409:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748477.279412:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1a912 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d66 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279423:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8adda17e1b00) 00010000:00010000:2.0:1788748477.279425:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788748477.279429:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69a00/0x9ba0f20a02e1a93c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d74 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279445:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:2.0:1788748477.279447:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748477.279451:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1a9ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3d90 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279463:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8addbc604100) 00010000:00010000:2.0:1788748477.279466:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788748477.279478:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add912bd000/0x9ba0f20a02e1affd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f50 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279495:0:7918:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8adc82598800) 00010000:00010000:2.0:1788748477.279497:0:7918:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788748477.279500:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68000/0x9ba0f20a02e1acb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3e70 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748477.279511:0:7918:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8addbf54e800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788748477.279525:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748477.279528:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748477.279529:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748477.289763:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748477.289930:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368715520 00000100:00100000:1.0:1788748477.289955:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368715520 00000100:00100000:1.0:1788748477.290036:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 258 00000100:00100000:1.0:1788748477.290046:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+5:2409:x1875638368715520:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:1.0:1788748477.290079:0:6511:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f5d 00000100:00080000:1.0:1788748477.290099:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8adc83e50800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788748477.290188:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788748477.290356:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788748477.290528:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53dfbad0-5125-4663-8fa7-3e1aae0338a8+3:2409:x1875638368715520:12345-192.168.203.22@tcp:39:umount.0 Request processed in 482us (778us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788748477.290537:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 258 00010000:00010000:1.0:1788748477.796720:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748478.244704:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748478.244739:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388676480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748478.244838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748478.245042:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676480 00000100:00100000:0.0:1788748478.245054:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676480 00000100:00100000:0.0:1788748478.245110:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788748478.245123:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388676480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748478.245159:0:7819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788748478.245267:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388676480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748478.245274:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788748478.246417:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388676480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788748478.820526:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748479.235635:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748479.235684:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748479.235722:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748479.235833:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368715648 00000100:00100000:3.0:1788748479.235851:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368715648 00000100:00100000:3.0:1788748479.235940:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368715904 00000100:00100000:3.0:1788748479.235944:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368715904 00000100:00100000:3.0:1788748479.235973:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368715776 00000100:00100000:3.0:1788748479.235976:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368715776 00000100:00100000:3.0:1788748479.236000:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1788748479.236011:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+12:2410:x1875638368715648:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748479.236030:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748479.236054:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb600/0x9ba0f20a02e1a059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3acd expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748479.236100:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748479.236183:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+11:2410:x1875638368715648:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 173us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748479.236191:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1788748479.236212:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788748479.236219:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+10:2410:x1875638368715904:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748479.236239:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748479.236249:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1a251 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3b8a expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748479.236259:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748479.236279:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+9:2410:x1875638368715904:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 60us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748479.236286:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788748479.236382:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788748479.236394:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+8:2410:x1875638368715776:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748479.236403:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748479.236417:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb200/0x9ba0f20a02e1a060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3afe expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748479.236429:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748479.236452:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09ef6cf0-4626-4079-99a4-603102db0d3e+7:2410:x1875638368715776:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 61us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748479.236459:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788748479.250120:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748479.250223:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368716160 00000100:00100000:3.0:1788748479.250247:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368716160 00000100:00100000:3.0:1788748479.250364:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 259 00000100:00100000:3.0:1788748479.250375:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+6:2409:x1875638368716160:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:3.0:1788748479.250414:0:8447:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e1a06e 00000020:00010000:3.0:1788748479.250421:0:8447:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8adc83fb3000: total 0 00000100:00080000:3.0:1788748479.250425:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8adc83fb7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788748479.250458:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1788748479.250609:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2409:x1875638368716160:12345-192.168.203.22@tcp:39:umount.0 Request processed in 235us (497us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788748479.250617:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 259 00000020:00010000:2.0:1788748479.250778:0:6498:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8adc83fb3000: total 0 00010000:00010000:2.0:1788748479.250783:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748479.250832:0:6498:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8adc83fb3000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788748479.250884:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adda17e1700) 00010000:00010000:2.0:1788748479.250888:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748479.250896:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b020 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f5e expref: 4 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748479.250917:0:6498:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8adc83fb3000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788748479.250927:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748479.250929:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748479.250931:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748479.251079:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748479.277985:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748479.278075:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368716288 00000100:00100000:0.0:1788748479.278085:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368716288 00000100:00100000:0.0:1788748479.278158:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 260 00000100:00100000:0.0:1788748479.278168:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+5:2409:x1875638368716288:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:0.0:1788748479.278210:0:6512:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e1a075 00000100:00080000:0.0:1788748479.278220:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8adc83fb4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748479.278310:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788748479.278503:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddb7c46a-889a-48c4-9f54-7a258d039b87+3:2409:x1875638368716288:12345-192.168.203.22@tcp:39:umount.0 Request processed in 335us (525us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788748479.278511:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 260 00000100:00080000:3.0:1788748479.278782:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788748479.283051:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748479.316051:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748479.316148:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368716544 00000100:00100000:1.0:1788748479.316159:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368716544 00000100:00100000:1.0:1788748479.316220:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 394 00000100:00100000:1.0:1788748479.316230:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+7:2409:x1875638368716544:12345-192.168.203.22@tcp:251:umount.0 00000020:00000080:1.0:1788748479.316275:0:6504:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f33 00000020:00010000:1.0:1788748479.316282:0:6504:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8addb53b1800: total 0 00000100:00080000:1.0:1788748479.316287:0:6504:0:(import.c:65:import_set_state_nolock()) ffff8addb53b6000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788748479.316391:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09ef6cf0-4626-4079-99a4-603102db0d3e+3:2409:x1875638368716544:12345-192.168.203.22@tcp:251:umount.0 Request processed in 162us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748479.316415:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 394 00000020:00010000:2.0:1788748479.316847:0:7918:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8addb53b1800: total 0 00010000:00010000:2.0:1788748479.316906:0:7918:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8addb53b1800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788748479.316936:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbba00/0x9ba0f20a02e19f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3abf expref: 2 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748479.316964:0:7918:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8addb53b1800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788748479.316977:0:7918:0:(genops.c:885:class_export_put()) final put ffff8addb53b1800/09ef6cf0-4626-4079-99a4-603102db0d3e 00010000:00010000:2.0:1788748479.316995:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748479.316998:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748479.317000:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788748479.317068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb53b1800/09ef6cf0-4626-4079-99a4-603102db0d3e for MGS 00000020:00000080:0.0:1788748479.317106:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addb53b6000 for MGS 00010000:00010000:2.0:1788748479.844460:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748480.297902:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748480.300049:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388676608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748480.304521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748480.307104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676608 00000100:00100000:3.0:1788748480.307119:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676608 00000100:00100000:2.0:1788748480.307516:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788748480.307528:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388676608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748480.307582:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788748480.309791:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388676608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2257us (5268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748480.309803:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788748480.309869:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388676608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748480.804805:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388676992:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.804853:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388677120:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.804918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748480.804971:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388677632:0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.804983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.805009:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388677504:0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.805051:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748480.805063:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388677120 00000100:00100000:1.0:1788748480.805071:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388677120 00000100:00100000:1.0:1788748480.805121:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788748480.805130:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388677120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.805179:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388677120:12345-0@lo:400:kworker.0 Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.805185:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788748480.805492:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388677504 00000100:00100000:1.0:1788748480.805496:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388677504 00000100:00100000:1.0:1788748480.805532:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788748480.805538:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388677504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748480.805589:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388676736:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.805589:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388677504:12345-0@lo:400:kworker.0 Request processed in 50us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.805602:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788748480.805634:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.805667:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388677248:0@lo:400:kworker.0 00000100:00100000:2.0:1788748480.805696:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.805716:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388677760:0@lo:400:kworker.0 00000100:00100000:2.0:1788748480.805737:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.805754:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388678272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748480.805794:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748480.805941:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388676864:0@lo:400:kworker.0 00000100:00100000:3.0:1788748480.805981:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748480.806002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388677376:0@lo:400:kworker.0 00000100:00100000:3.0:1788748480.806021:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748480.806038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388677888:0@lo:400:kworker.0 00000100:00100000:3.0:1788748480.806058:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748480.806386:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388677504:0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.806403:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388678016:0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.806430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748480.806907:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676992 00000100:00100000:1.0:1788748480.806914:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676992 00000100:00100000:3.0:1788748480.806967:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388677248 00000100:00100000:3.0:1788748480.806973:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388677248 00000100:00100000:3.0:1788748480.807008:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388677760 00000100:00100000:3.0:1788748480.807011:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388677760 00000100:00100000:3.0:1788748480.807026:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676864 00000100:00100000:3.0:1788748480.807029:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676864 00000100:00100000:1.0:1788748480.807192:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788748480.807202:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388676992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.807862:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388676992:12345-0@lo:400:kworker.0 Request processed in 659us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748480.807872:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388676992:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.807873:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788748480.807900:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388677888 00000100:00100000:0.0:1788748480.807906:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388677888 00000100:00100000:0.0:1788748480.807932:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788748480.807939:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388677248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.807978:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388677248:12345-0@lo:400:kworker.0 Request processed in 40us (2282us total) trans 0 rc 0/0 00000100:00080000:1.0:1788748480.807979:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748480.807987:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748480.807987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:1.0:1788748480.807991:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748480.808009:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678016 00000100:00100000:0.0:1788748480.808010:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788748480.808016:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678016 00000100:00100000:0.0:1788748480.808022:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388677760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.808059:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788748480.808061:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388677760:12345-0@lo:400:kworker.0 Request processed in 42us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.808071:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388678016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.808072:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788748480.808116:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388678016:12345-0@lo:400:kworker.0 Request processed in 49us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.808122:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788748480.808142:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388676736 00000100:00100000:1.0:1788748480.808146:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388676736 00000100:00100000:1.0:1788748480.808171:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788748480.808178:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388676736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748480.808197:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388677248:0@lo:400:kworker.0 00000100:00100000:2.0:1788748480.808216:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388677760:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.808218:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388676736:12345-0@lo:400:kworker.0 Request processed in 39us (2582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.808229:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788748480.808243:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388676736:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.808270:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788748480.808279:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388676864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.808387:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388676864:12345-0@lo:400:kworker.0 Request processed in 40us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.808394:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788748480.808408:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788748480.808415:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388677888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.808445:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388677888:12345-0@lo:400:kworker.0 Request processed in 31us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.808450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1788748480.808506:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748480.808891:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388678400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748480.808928:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748480.808969:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388676864:0@lo:400:kworker.0 00010000:00080000:2.0:1788748480.808983:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdc380 x1875638388677888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748480.808993:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388677888:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.809052:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678272 00000100:00100000:1.0:1788748480.809057:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678272 00000100:00100000:1.0:1788748480.809095:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678400 00000100:00100000:1.0:1788748480.809098:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678400 00000100:00100000:1.0:1788748480.809108:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788748480.809114:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388678272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748480.809136:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748480.809171:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388678272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.809177:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788748480.809189:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788748480.809194:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388678400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748480.809202:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748480.809223:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388678400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.809228:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788748480.809432:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748480.809661:0:10244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388677376 00000100:00100000:3.0:1788748480.809667:0:10244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388677376 00000100:00100000:3.0:1788748480.809704:0:10244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788748480.809711:0:10244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388677376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748480.809762:0:10244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388677376:12345-0@lo:400:kworker.0 Request processed in 52us (3739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748480.809769:0:10244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788748480.810265:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388677632 00000100:00100000:1.0:1788748480.810271:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388677632 00000100:00100000:0.0:1788748480.810298:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388678144:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.810340:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788748480.810351:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388677632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.810364:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748480.810403:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388677632:12345-0@lo:400:kworker.0 Request processed in 55us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748480.810409:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388677120:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.810414:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788748480.810427:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388677632:0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.810430:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678144 00000100:00100000:1.0:1788748480.810435:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678144 00000100:00100000:1.0:1788748480.810462:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788748480.810469:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388678144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748480.810512:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388678144:12345-0@lo:400:kworker.0 Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748480.810518:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788748480.810636:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788748480.810641:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748480.810643:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788748480.810674:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388678400:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788748480.810819:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc82fdea00 x1875638388677376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748480.810906:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388678144:0@lo:400:kworker.0 00000100:00100000:0.0:1788748480.810933:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388678016:0@lo:400:kworker.0 00000100:00100000:2.0:1788748480.811035:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388677376:0@lo:400:kworker.0 00000100:00100000:2.0:1788748480.812930:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388678272:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788748480.813758:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000001:00080000:3.0:1788748480.813772:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788748480.813777:0:6489:0:(genops.c:885:class_export_put()) final put ffff8adc83fb3000/ddb7c46a-889a-48c4-9f54-7a258d039b87 00000001:00100000:3.0:1788748480.813795:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000001:00080000:3.0:1788748480.813813:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788748480.813832:0:6489:0:(genops.c:885:class_export_put()) final put ffff8addbf54e800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:0.0:1788748480.813954:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83fb3000/ddb7c46a-889a-48c4-9f54-7a258d039b87 for lustre-MDT0000 00000020:00000080:0.0:1788748480.814030:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf54e800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 for lustre-MDT0000 00000020:00000080:0.0:1788748480.814059:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83fb7800 for lustre-MDT0000 00000020:00000080:0.0:1788748480.814066:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf54b800 for lustre-MDT0000 00010000:00010000:1.0:1788748480.874515:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748481.169087:0:15194:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788748481.196468:0:15194:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788748481.196524:0:15194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.196539:0:15194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.196570:0:15194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.196577:0:15194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.196603:0:15194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788748481.196609:0:15194:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788748481.196633:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748481.196638:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788748481.196643:0:15194:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788748481.196666:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8add8f101000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788748481.196973:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748481.196981:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.196991:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748481.196995:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.197005:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748481.197012:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748481.197018:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748481.197021:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788748481.197023:0:7918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788748481.197048:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.197066:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748481.197098:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.197106:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addb3bba400/0x9ba0f20a02e19fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ff0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.197118:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748481.197119:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748481.197121:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748481.197165:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388678528:0@lo:39:umount.0 00000100:00100000:0.0:1788748481.197293:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748481.197345:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388678656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748481.197386:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748481.197408:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678656 00000100:00100000:0.0:1788748481.197415:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678656 00000100:00100000:0.0:1788748481.197472:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748481.197481:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3638:x1875638388678656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748481.197494:0:9515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748481.197509:0:9515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e19ff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19fe9 expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748481.197522:0:9515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748481.197577:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:3638:x1875638388678656:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748481.197585:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748481.197599:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388678656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748481.197665:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678528 00000100:00100000:3.0:1788748481.197670:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678528 00000100:00100000:3.0:1788748481.197706:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788748481.197712:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875638388678528:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788748481.197734:0:6511:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19b4a 00000100:00080000:3.0:1788748481.197742:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8addb38d2000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788748481.197806:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1875638388678528:12345-0@lo:39:umount.0 Request processed in 94us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748481.197813:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:3.0:1788748481.197836:0:6511:0:(genops.c:885:class_export_put()) final put ffff8addb38d0800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788748481.197880:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add8f101000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1788748481.197895:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb38d0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1788748481.197896:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388678528:0@lo:39:umount.0 00000020:00000080:1.0:1788748481.197941:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addb38d2000 for lustre-MDT0000 00000100:00080000:2.0:1788748481.197982:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748481.197985:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788748481.197989:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788748481.198081:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748481.200105:0:15194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200123:0:15194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200130:0:15194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200137:0:15194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200160:0:15194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748481.200181:0:15194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200187:0:15194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200193:0:15194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200199:0:15194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200218:0:15194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788748481.200223:0:15194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200231:0:15194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.200237:0:15194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200271:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748481.200279:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200289:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748481.200301:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200310:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748481.200344:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748481.200351:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748481.200353:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788748481.200380:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200386:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748481.200414:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200421:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e19ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ffe expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200435:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748481.200438:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200443:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748481.200446:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200453:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748481.200470:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748481.200475:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748481.200477:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788748481.200479:0:7918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788748481.200493:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200499:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748481.200505:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200511:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc941400/0x9ba0f20a02e19eed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ef4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200519:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748481.200521:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748481.200523:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748481.200539:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388678912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748481.200604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748481.200649:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748481.200655:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388678784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748481.200677:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748481.200706:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678912 00000100:00100000:3.0:1788748481.200712:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678912 00000100:00100000:3.0:1788748481.200752:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388678784 00000100:00100000:3.0:1788748481.200755:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388678784 00000100:00100000:3.0:1788748481.200778:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748481.200794:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+24:3636:x1875638388678912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748481.200807:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748481.200839:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f7a00/0x9ba0f20a02e19ef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19eed expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200852:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748481.200866:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748481.200890:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+23:3636:x1875638388678912:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748481.200898:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748481.200907:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388678912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748481.200920:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748481.200929:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+22:3636:x1875638388678784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748481.200937:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748481.200945:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6200/0x9ba0f20a02e19ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19ff7 expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.200956:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748481.200982:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3636:x1875638388678784:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748481.200989:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788748481.200993:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:27ab3bfa-63dd-419e-978e-87fcee7a537d:3636:1875638388678784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748481.201043:0:15194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.201850:0:15194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748481.201864:0:15194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.201874:0:15194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.201891:0:15194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.201898:0:15194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.203625:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748481.203637:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.203648:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fba00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748481.203652:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.203661:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748481.203669:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748481.203674:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788748481.203691:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788748481.203694:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788748481.203733:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.203740:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788748481.203968:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388679040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748481.204025:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748481.204923:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.204936:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813fba00/0x9ba0f20a02e1a243 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e1a24a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748481.204937:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388679040 00000100:00100000:3.0:1788748481.204947:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388679040 00010000:00010000:1.0:1788748481.204957:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748481.204963:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.204970:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76a00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748481.204973:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.204982:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748481.204989:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748481.204995:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748481.204997:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00100000:3.0:1788748481.205007:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748481.205017:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3637:x1875638388679040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748481.205020:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.205028:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788748481.205033:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748481.205048:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1a24a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e1a243 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748481.205062:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788748481.206913:0:15194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1788748481.206927:0:15194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788748481.206936:0:15194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788748481.206939:0:15194:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788748481.207114:0:15194:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788748481.207119:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788748481.207124:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748481.207129:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788748481.207136:0:15194:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8adc838bc800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748481.207143:0:15194:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8adc825ba800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748481.207148:0:15194:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8addb3d10000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748481.207153:0:15194:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8addbc784800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788748481.207159:0:15194:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8add885b99c0) has exports, disconnecting them 00000020:00080000:2.0:1788748481.207163:0:15194:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8adc838bc800), last request at 1788748480 00000020:00000080:2.0:1788748481.207170:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19e5a 00000100:00080000:2.0:1788748481.207187:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8adc838bf800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788748481.207237:0:15194:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc838bc800): rc 0 00000020:00000080:2.0:1788748481.207240:0:15194:0:(genops.c:885:class_export_put()) final put ffff8adc838bc800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788748481.207260:0:15194:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8adc825ba800), last request at 1788748480 00000020:00000080:2.0:1788748481.207263:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d34 00000100:00080000:2.0:1788748481.207269:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8adc825be800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788748481.207290:0:15194:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc825ba800): rc 0 00000020:00000080:2.0:1788748481.207292:0:15194:0:(genops.c:885:class_export_put()) final put ffff8adc825ba800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788748481.207296:0:15194:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8addb3d10000), last request at 1788748258 00000020:00000080:2.0:1788748481.207299:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19c31 00000100:00080000:2.0:1788748481.207302:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788748481.207308:0:15194:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8addb3d10000): rc 0 00000020:00000080:2.0:1788748481.207310:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addb3d10000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788748481.207313:0:15194:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8addbc784800), last request at 1788748258 00000020:00000080:2.0:1788748481.207344:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19bf2 00000100:00080000:2.0:1788748481.207347:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8addb3d12800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788748481.207353:0:15194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1788748481.207434:0:15194:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8addbc784800): rc 0 00000004:00000080:2.0:1788748481.207440:0:15194:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf7081cdfae0 00000100:00080000:2.0:1788748481.207457:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788748481.207460:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788748481.210348:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.210366:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76a00/0x9ba0f20a02e19aa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19ab0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748481.210388:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748481.210390:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748481.210392:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748481.210405:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748481.210574:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388679168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748481.210643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788748481.211421:0:15194:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788748481.211449:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8addb3927800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788748481.211614:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388679296:0@lo:39:umount.0 00000100:00100000:1.0:1788748481.211660:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748481.211704:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388679296 00000100:00100000:1.0:1788748481.211712:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388679296 00000100:00100000:1.0:1788748481.211754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1788748481.211890:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788748481.211894:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788748481.211906:0:15194:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788748481.212010:0:15194:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788748481.212021:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8adc8387f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788748481.212030:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788748481.212032:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788748481.212039:0:15194:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788748481.212095:0:15194:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788748481.212104:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8adc83d2e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788748481.212132:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8add885b99c0) has no exports 00000100:00100000:1.0:1788748481.212864:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1875638388679296:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788748481.212896:0:6516:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19c8c 00000100:00080000:1.0:1788748481.212906:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8addbc787800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788748481.212934:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788748481.213857:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748481.214410:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388679168 00000100:00100000:2.0:1788748481.214420:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388679168 00000100:00100000:2.0:1788748481.214478:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748481.214488:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+21:3638:x1875638388679168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748481.214500:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748481.214518:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6400/0x9ba0f20a02e19ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19aa9 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748481.214534:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748481.215016:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:27ab3bfa-63dd-419e-978e-87fcee7a537d+20:3637:x1875638388679040:12345-0@lo:103:ldlm_bl.0 Request processed in 9998us (10987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748481.215026:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748481.215296:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388679040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748481.215349:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:0:1875638388679424:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788748481.215371:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc838bc800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788748481.215413:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc825ba800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788748481.215433:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d10000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788748481.215455:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc838bf800 for lustre-MDT0000 00000020:00000080:0.0:1788748481.215474:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc825be800 for lustre-MDT0000 00000020:00000080:0.0:1788748481.215476:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addb3d14800 for lustre-MDT0000 00000100:00100000:1.0:1788748481.216380:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3634:x1875638388679296:12345-0@lo:39:umount.0 Request processed in 4615us (4716us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788748481.216391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788748481.216448:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388679552:0@lo:9:umount.0 00000100:00100000:1.0:1788748481.216487:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748481.216515:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388679680:0@lo:9:umount.0 00000100:00100000:1.0:1788748481.216536:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748481.216590:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3927800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788748481.216597:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388679296:0@lo:39:umount.0 00000100:00100000:2.0:1788748481.217385:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:3638:x1875638388679168:12345-0@lo:103:ldlm_bl.0 Request processed in 2897us (6739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748481.217395:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788748481.217439:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748481.217511:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388679168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748481.217995:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388679552 00000100:00100000:0.0:1788748481.218002:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388679552 00000100:00100000:0.0:1788748481.218045:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388679680 00000100:00100000:0.0:1788748481.218048:0:8427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388679680 00000100:00100000:0.0:1788748481.218075:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788748481.218084:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875638388679552:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788748481.218112:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19ddc 00000100:00080000:0.0:1788748481.218121:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8adc8387d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748481.218167:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788748481.218308:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3634:x1875638388679552:12345-0@lo:9:umount.0 Request processed in 225us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748481.218334:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788748481.218350:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788748481.218357:0:8427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875638388679680:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788748481.218369:0:8427:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f1e 00000100:00080000:0.0:1788748481.218375:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8adc83d2b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788748481.218399:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788748481.218469:0:8427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3634:x1875638388679680:12345-0@lo:9:umount.0 Request processed in 113us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748481.218477:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788748481.218501:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748481.218526:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc8387f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788748481.218547:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788748481.218560:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788748481.218565:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388679552:0@lo:9:umount.0 00000100:00080000:0.0:1788748481.218580:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc83d2e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788748481.218610:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788748481.218613:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788748481.218617:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388679680:0@lo:9:umount.0 00010000:00010000:0.0:1788748481.218641:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788748481.234500:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8add885b99c0) has no exports 00000020:00000080:3.0:1788748481.300972:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19b04 00000020:00000080:3.0:1788748481.300987:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addb3926800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788748481.301008:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788748481.301102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3926800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788748481.301200:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748481.301210:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788748481.301215:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8add9ea63380) has no exports 00000020:00000080:2.0:1788748481.305156:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19afd 00000020:00000080:2.0:1788748481.305170:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addb38d0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788748481.305233:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748481.305245:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788748481.305248:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add873d4800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788748481.305252:0:15194:0:(genops.c:844:class_export_destroy()) destroying export ffff8add873d4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788748481.305261:0:15194:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788748481.305584:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb38d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788748481.318241:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388679808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748481.318335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748481.318486:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388679808 00000100:00100000:3.0:1788748481.318494:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388679808 00000100:00100000:3.0:1788748481.318542:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788748481.318562:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388679808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748481.318591:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788748481.318642:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388679808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748481.318649:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788748481.318800:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388679808:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788748481.892466:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788748482.855083:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788748482.855104:0:8419:0:(genops.c:885:class_export_put()) final put ffff8adc83878800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788748482.855138:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:0.0:1788748482.855141:0:8419:0:(genops.c:885:class_export_put()) final put ffff8add85231800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:2.0:1788748482.855402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83878800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788748482.855599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8add85231800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 for lustre-OST0000 00000020:00000080:2.0:1788748482.855622:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc8387d800 for lustre-OST0000 00000020:00000080:2.0:1788748482.855628:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8add852ab000 for lustre-OST0000 00000001:00100000:3.0:1788748482.857738:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788748482.857748:0:9505:0:(genops.c:885:class_export_put()) final put ffff8adc83d2f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788748482.858019:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788748482.858040:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788748482.858044:0:7442:0:(genops.c:885:class_export_put()) final put ffff8addbc787000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788748482.869077:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:3.0:1788748482.869087:0:9505:0:(genops.c:885:class_export_put()) final put ffff8adc838ba800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000001:00100000:1.0:1788748482.869156:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ddb7c46a-889a-48c4-9f54-7a258d039b87 00000001:00080000:1.0:1788748482.869164:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788748482.869168:0:7442:0:(genops.c:885:class_export_put()) final put ffff8adc83fb1000/ddb7c46a-889a-48c4-9f54-7a258d039b87 00000001:00100000:1.0:1788748482.869174:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000001:00080000:1.0:1788748482.869180:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788748482.869182:0:7442:0:(genops.c:885:class_export_put()) final put ffff8adc83e52000/53dfbad0-5125-4663-8fa7-3e1aae0338a8 00000020:00000080:0.0:1788748482.873193:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83d2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788748482.873454:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbc787000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788748482.874161:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83fb1000/ddb7c46a-889a-48c4-9f54-7a258d039b87 for lustre-MDT0001 00000020:00000080:0.0:1788748482.874193:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83e52000/53dfbad0-5125-4663-8fa7-3e1aae0338a8 for lustre-MDT0001 00000020:00000080:0.0:1788748482.874212:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83d2b000 for lustre-OST0001 00000020:00000080:0.0:1788748482.874216:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbc787800 for lustre-MDT0001 00000020:00000080:0.0:1788748482.874219:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83fb4800 for lustre-MDT0001 00000020:00000080:0.0:1788748482.874223:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83e50800 for lustre-MDT0001 00000020:00000080:0.0:1788748482.875020:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc838ba800/53dfbad0-5125-4663-8fa7-3e1aae0338a8 for lustre-OST0001 00000020:00000080:0.0:1788748482.875126:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc838b9000 for lustre-OST0001 00010000:00010000:0.0:1788748482.917018:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748483.365027:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388679936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748483.365096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748483.365228:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388679936 00000100:00100000:3.0:1788748483.365236:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388679936 00000100:00100000:3.0:1788748483.365282:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788748483.365289:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875638388679936:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788748483.365297:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788748483.365363:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875638388679936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (267us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788748483.365370:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:02020000:0.0:1788748483.365755:0:3637:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788748483.381036:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788748483.381043:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788748483.381047:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788748483.392195:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748483.392209:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 175 00000100:00080000:0.0:1788748483.392235:0:3637:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8addb3d14000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748483.397629:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8380ca80 x1875638388680064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748483.397751:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388680064:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788748483.397835:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748483.398052:0:7819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680064 00000100:00100000:2.0:1788748483.398073:0:7819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680064 00000100:00100000:2.0:1788748483.398118:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788748483.398125:0:7819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875638388680064:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788748483.398143:0:7819:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788748483.408075:0:7819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875638388680064:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 9940us (10231us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788748483.408089:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1788748483.410996:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748483.411010:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788748483.411015:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388680064:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788748483.943349:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748484.964474:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748485.924655:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388680192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748485.924724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748485.925169:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788748485.925174:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788748485.925177:0:38:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748485.925194:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 400 00000100:00080000:1.0:1788748485.925200:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788748485.925209:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8addb3d14000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748485.925232:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc825c1180 x1875638388680448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748485.925295:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388680448:0@lo:38:kworker.0 00000100:00100000:1.0:1788748485.925350:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925452:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388680320:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.925484:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925526:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388680960:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.925552:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925569:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748485.925574:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388680576:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.925595:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925609:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388681088:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.925626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925649:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388680832:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.925671:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925686:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788748485.925691:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388680704:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.925712:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925726:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388681216:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.925758:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748485.925783:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680576 00000100:00100000:2.0:1788748485.925790:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680576 00000100:00100000:2.0:1788748485.927152:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388681088 00000100:00100000:2.0:1788748485.927163:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388681088 00000100:00100000:2.0:1788748485.927186:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680832 00000100:00100000:2.0:1788748485.927189:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680832 00000100:00100000:2.0:1788748485.927218:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680704 00000100:00100000:2.0:1788748485.927222:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680704 00000100:00100000:2.0:1788748485.927230:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388681216 00000100:00100000:2.0:1788748485.927232:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388681216 00000100:00100000:2.0:1788748485.927251:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788748485.927260:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388680832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.927352:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388680832:12345-0@lo:400:kworker.0 Request processed in 93us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748485.927359:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788748485.927376:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788748485.927382:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388681216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.927410:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875638388681216:12345-0@lo:400:kworker.0 Request processed in 29us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748485.927416:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788748485.927426:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788748485.927431:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875638388680576:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788748485.927436:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788748485.927464:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875638388680576:12345-0@lo:400:kworker.0 Request processed in 32us (1868us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788748485.927470:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788748485.927480:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788748485.927495:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875638388681088:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788748485.927501:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788748485.927537:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875638388681088:12345-0@lo:400:kworker.0 Request processed in 41us (1910us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788748485.927543:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788748485.927555:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788748485.927559:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875638388680704:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788748485.927564:0:8447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788748485.927587:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1875638388680704:12345-0@lo:400:kworker.0 Request processed in 26us (1874us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788748485.927593:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1788748485.927627:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788748485.927657:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788748485.927663:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8adda719a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788748485.927666:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788748485.929534:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680192 00000100:00100000:3.0:1788748485.929560:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680192 00000100:00100000:3.0:1788748485.929622:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788748485.929631:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388680192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788748485.929658:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788748485.929722:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388680192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (4998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748485.929729:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788748485.929762:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788748485.930123:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788748485.930127:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788748485.930130:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788748485.930135:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748485.930139:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 193 00000100:00080000:3.0:1788748485.930147:0:3638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc82c20800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748485.930177:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8add8f160380 x1875638388681344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748485.930200:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388680704:0@lo:400:kworker.0 00010000:00080000:3.0:1788748485.930215:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84938000 x1875638388681216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748485.930227:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388681216:0@lo:400:kworker.0 00010000:00080000:3.0:1788748485.930238:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc825c2680 x1875638388680832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748485.930246:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388680832:0@lo:400:kworker.0 00000100:00100000:3.0:1788748485.930261:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388680192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748485.930464:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680320 00000100:00100000:1.0:1788748485.930470:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680320 00000100:00100000:1.0:1788748485.930503:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788748485.930510:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:3635:x1875638388680320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748485.930565:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add9ebfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27ab3bfa-63dd-419e-978e-87fcee7a537d+19:3635:x1875638388680320:12345-0@lo:400:kworker.0 Request processed in 56us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748485.930571:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788748485.930603:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680960 00000100:00100000:1.0:1788748485.930607:0:8425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680960 00000100:00100000:1.0:1788748485.930638:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788748485.930645:0:8425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388680960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748485.930676:0:8425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388680960:12345-0@lo:400:kworker.0 Request processed in 31us (5123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748485.930681:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788748485.930697:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748485.930710:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388681344:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788748485.930740:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748485.930772:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388681344 00000100:00100000:1.0:1788748485.930776:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388681344 00000100:00100000:1.0:1788748485.930804:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788748485.930808:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875638388681344:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788748485.930834:0:8447:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788748485.930901:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388680448 00000100:00100000:0.0:1788748485.930915:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388680448 00000100:00100000:0.0:1788748485.930948:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788748485.930954:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875638388680448:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788748485.930963:0:6516:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788748485.930999:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875638388680448:12345-0@lo:38:kworker.0 Request processed in 44us (5649us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788748485.931006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1788748485.931042:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748485.931047:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788748485.931050:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388680448:0@lo:38:kworker.0 00000100:00080000:2.0:1788748485.950343:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8adda719a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748485.950355:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 175 00000100:00080000:2.0:1788748485.950370:0:3635:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8adda719a000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748485.950414:0:3635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e7b80 x1875638388681472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748485.950440:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388680576:0@lo:400:kworker.0 00000100:00080000:2.0:1788748485.950472:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788748485.950475:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788748485.950479:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788748485.950505:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748485.950509:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 213 00000100:00080000:2.0:1788748485.950515:0:3635:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc83d29000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748485.950537:0:3635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e6a00 x1875638388681600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748485.950547:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388681088:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.950572:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388680320:0@lo:400:kworker.0 00000100:00100000:2.0:1788748485.950586:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388680960:0@lo:400:kworker.0 00000100:00100000:0.0:1788748485.950833:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388681472:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788748485.950917:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748485.951145:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388681600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788748485.951174:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748485.951224:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388681472 00000100:00100000:0.0:1788748485.951231:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388681472 00000100:00100000:0.0:1788748485.951261:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388681600 00000100:00100000:0.0:1788748485.951265:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388681600 00000100:00100000:0.0:1788748485.951282:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788748485.951297:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388681472:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788748485.951340:0:6511:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788748485.951380:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388681472:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 83us (463us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788748485.951388:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788748485.951403:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788748485.951407:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388681600:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788748485.951415:0:6511:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788748485.951437:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388681600:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (263us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788748485.951443:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788748485.951474:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adda719a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748485.951478:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788748485.951482:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388681472:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788748485.951489:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748485.951493:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788748485.951496:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388681600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788748485.962886:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875638388681344:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 32067us (32136us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788748485.963130:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748485.963139:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788748485.963143:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388681344:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788748485.963268:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000040:00080000:0.0:1788748485.990678:0:13790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748485.991190:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748486.436779:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748486.437861:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388681728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748486.437932:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748486.440116:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388681728 00000100:00100000:0.0:1788748486.440130:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388681728 00000100:00100000:0.0:1788748486.440201:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788748486.440211:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388681728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748486.440259:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788748486.440358:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388681728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748486.440366:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788748486.440547:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388681728:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788748486.950459:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788748486.950469:0:6489:0:(genops.c:885:class_export_put()) final put ffff8addbc784800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788748486.950557:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbc784800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788748486.950622:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addb3d12800 for lustre-MDT0000 00010000:00010000:0.0:1788748487.013449:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788748487.403447:0:15194:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adc82ceec00 - data ffff8adda770b798/ffff8addb51ba000 00000020:01000000:2.0:1788748487.403645:0:15194:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8add86104f60 - data ffff8adda75351b0/ffff8add9eaf3800 00000001:00000004:2.0:1788748487.411945:0:15194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1788748487.499305:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788748487.499423:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788748487.499441:0:15194:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8addb533f800 x1875638388679296/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788748491 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748487.499465:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788748487.502498:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788748487.502505:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788748487.503491:0:15194:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788748487.503495:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788748487.511565:0:8738:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788748487.511572:0:8738:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788748487.511582:0:8738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788748487.514860:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788748487.514867:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788748487.515599:0:15194:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788748487.515603:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788748487.518583:0:10014:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788748487.518590:0:10014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788748487.518601:0:10014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788748487.538399:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19acc 00000020:00000080:3.0:1788748487.538414:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add8f105800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788748487.538540:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8add8f105800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788748487.541240:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19ae1 00000020:00000080:3.0:1788748487.541253:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addae41b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788748487.541273:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788748487.541279:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748487.541287:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788748487.541291:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8add885bcd40) has no exports 00000020:00000080:2.0:1788748487.541356:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addae41b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788748487.541474:0:15194:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788748487.541482:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f17 00000020:00000080:3.0:1788748487.541486:0:15194:0:(genops.c:885:class_export_put()) final put ffff8adc83e53800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788748487.541500:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788748487.541504:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748487.541521:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748487.541524:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8adc840f8000) has no exports 00000020:00000080:3.0:1788748487.541530:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19f10 00000020:00000080:2.0:1788748487.541533:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83e53800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788748487.541536:0:15194:0:(genops.c:885:class_export_put()) final put ffff8adc83d2a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788748487.541550:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83d2a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788748487.541888:0:15194:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788748487.541893:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788748487.541897:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788748487.541902:0:15194:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748487.541904:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748487.541946:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748487.541955:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788748487.541956:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83d2e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788748487.541961:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19dd5 00000020:00000080:2.0:1788748487.541965:0:8:0:(genops.c:885:class_export_put()) final put ffff8adc83e54800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788748487.541968:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addbf469000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788748487.541969:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83e54800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788748487.541977:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:01000000:2.0:1788748487.541978:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788748487.541982:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748487.541987:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748487.541999:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8addb53899c0) has no exports 00000020:00000080:3.0:1788748487.542004:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19dce 00000020:00000080:3.0:1788748487.542007:0:15194:0:(genops.c:885:class_export_put()) final put ffff8adc83879800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788748487.542073:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf469000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788748487.542082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83879800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788748487.542373:0:15194:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788748487.542377:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788748487.542379:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788748487.542383:0:15194:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748487.542384:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748487.542419:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748487.542425:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788748487.542434:0:15194:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788748487.542438:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19c85 00000020:00000080:3.0:1788748487.542443:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add88484000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788748487.542446:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788748487.542449:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748487.542452:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748487.542455:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8addaea8cd40) has no exports 00000020:00000080:3.0:1788748487.542458:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19c7e 00000020:00000080:3.0:1788748487.542460:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addb3922800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788748487.542525:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc8387f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788748487.542532:0:8:0:(genops.c:885:class_export_put()) final put ffff8adc8387a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788748487.542534:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc8387a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788748487.542541:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788748487.542580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8add88484000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788748487.542588:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3922800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788748487.544727:0:15194:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788748487.544736:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788748487.544752:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788748487.544760:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788748487.544792:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addb3927800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788748487.544844:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748487.544857:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748487.544862:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addb3bc6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788748487.544866:0:15194:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3bc6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788748487.544881:0:15194:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748487.545011:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748487.545025:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748487.545030:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add8f107000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788748487.545033:0:15194:0:(genops.c:844:class_export_destroy()) destroying export ffff8add8f107000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788748487.545040:0:15194:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748487.545562:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19ae8 00000020:00000080:1.0:1788748487.545571:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addae41f800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788748487.545583:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788748487.545594:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addae41f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788748487.545607:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748487.545612:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788748487.545616:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8add885bb380) has no exports 00000020:00000080:1.0:1788748487.545635:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748487.545639:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788748487.545641:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add88486800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788748487.545652:0:15194:0:(genops.c:844:class_export_destroy()) destroying export ffff8add88486800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788748487.545656:0:15194:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788748487.545697:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19aef 00000020:00000080:1.0:1788748487.545701:0:15194:0:(genops.c:885:class_export_put()) final put ffff8addae419800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788748487.545713:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addae419800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788748487.545724:0:15194:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adda7357000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788748487.545727:0:15194:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adda7357000 3 00000020:01000004:1.0:1788748487.545738:0:15194:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adda7357000 from lustre-MDT0000 00000020:00000080:1.0:1788748487.545757:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748487.545761:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788748487.545764:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add8f100800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788748487.545766:0:15194:0:(genops.c:844:class_export_destroy()) destroying export ffff8add8f100800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788748487.545773:0:15194:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788748487.545808:0:15194:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788748487.545811:0:15194:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788748487.545814:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788748487.545816:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748487.545819:0:15194:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788748487.545826:0:15194:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8add90aad800 27ab3bfa-63dd-419e-978e-87fcee7a537d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788748487.545831:0:15194:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8add885b8000) has exports, disconnecting them 00000020:00080000:1.0:1788748487.545835:0:15194:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8add90aad800), last request at 1788748239 00000020:00000080:1.0:1788748487.545849:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19a8d 00000020:00010000:1.0:1788748487.545853:0:15194:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8add90aad800: total 0 00000100:00080000:1.0:1788748487.545857:0:15194:0:(import.c:65:import_set_state_nolock()) ffff8add90aad000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788748487.545870:0:15194:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8add90aad800): rc 0 00000020:00080000:1.0:1788748487.545874:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8add885b8000) has no exports 00000100:00100000:1.0:1788748487.545923:0:6504:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8add91e31000:6504] 2 exiting: rc = 0 00000100:00100000:1.0:1788748487.546017:0:6503:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8add91e30000:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1788748487.546070:0:6502:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8add95ee5800:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1788748487.546137:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.546145:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.546151:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.546158:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.546164:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.546169:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.546182:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.546189:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:2.0:1788748487.547033:0:7918:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8add90aad800: total 0 00010000:00010000:2.0:1788748487.547449:0:7918:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8add90aad800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788748487.547481:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbbc00/0x9ba0f20a02e19fb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19fb1 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748487.547499:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6a00/0x9ba0f20a02e19faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19fa3 expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547518:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547529:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6000/0x9ba0f20a02e19fc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19fbf expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547537:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547546:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc941e00/0x9ba0f20a02e19fd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19fcd expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547559:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547563:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add80031600/0x9ba0f20a02e19b89 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19b82 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547574:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547583:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547592:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbae00/0x9ba0f20a02e19fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19fdb expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547592:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547602:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547608:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add80030800/0x9ba0f20a02e19b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19b90 expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547611:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547622:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547632:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547641:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547645:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1a220 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e1a219 expref: 7 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547655:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547664:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547667:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76600/0x9ba0f20a02e1a22e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e1a227 expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547678:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547686:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76c00/0x9ba0f20a02e1a23c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e1a235 expref: 5 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547694:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547708:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547711:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f7600/0x9ba0f20a02e1a00c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e1a005 expref: 4 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547720:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547729:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547731:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f6c00/0x9ba0f20a02e19f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19f95 expref: 3 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547741:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547748:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547759:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547762:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add839f7200/0x9ba0f20a02e19eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9ba0f20a02e19ea7 expref: 2 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748487.547772:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547784:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547790:0:7918:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8add90aad800, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1788748487.547790:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547798:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547809:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788748487.547811:0:7918:0:(genops.c:885:class_export_put()) final put ffff8add90aad800/27ab3bfa-63dd-419e-978e-87fcee7a537d 00000100:00100000:1.0:1788748487.547817:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547824:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547828:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748487.547832:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748487.547835:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788748487.547836:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748487.547844:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788748487.547847:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8add90aad800/27ab3bfa-63dd-419e-978e-87fcee7a537d for MGS 00000100:00100000:1.0:1788748487.547853:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547859:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547865:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547871:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547879:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547887:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788748487.547891:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8add90aad000 for MGS 00000100:00100000:1.0:1788748487.547896:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547912:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547917:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547922:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547927:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547932:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547937:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547942:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547947:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547953:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547958:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547964:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547971:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547976:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547983:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547989:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547994:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.547999:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.548005:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748487.548012:0:15194:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788748487.560833:0:15194:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8add9e411cc0 - data ffff8adda7709288/ffff8addbc931400 00000020:01000000:2.0:1788748487.560944:0:15194:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8add91a0b5a0 - data ffff8add982b11b0/ffff8addba630400 00000020:00000080:2.0:1788748487.561701:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19a71 00000020:00000080:2.0:1788748487.561710:0:15194:0:(genops.c:885:class_export_put()) final put ffff8adda15b6000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788748487.561776:0:15194:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adda7357000 from MGS, refs=2 00000020:01000004:2.0:1788748487.561779:0:15194:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adda7357000 2 00000020:01000004:2.0:1788748487.561782:0:15194:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adda7357000 from MGS 00000020:00000080:2.0:1788748487.561805:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748487.561811:0:15194:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788748487.561814:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add87c11000/MGS 00000020:00000080:2.0:1788748487.561816:0:15194:0:(genops.c:844:class_export_destroy()) destroying export ffff8add87c11000/MGS for MGS 00000020:01000000:2.0:1788748487.561823:0:15194:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788748487.561880:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788748487.561884:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748487.561889:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788748487.561895:0:15194:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8add8f101800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748487.561901:0:15194:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8addb3938000) has exports, disconnecting them 00000020:00080000:2.0:1788748487.561905:0:15194:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8add8f101800), last request at 1788748239 00000020:00000080:2.0:1788748487.561910:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19b3c 00000020:00080000:2.0:1788748487.561919:0:15194:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8add8f101800): rc 0 00000020:00000080:2.0:1788748487.561924:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add8f101800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788748487.561995:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adda15b6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788748487.562125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8add8f101800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788748487.653190:0:15194:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788748487.653563:0:15194:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748487.653568:0:15194:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788748487.653575:0:15194:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788748487.653787:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748487.653795:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788748487.653802:0:15194:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adda7357000 1 00000020:00000080:2.0:1788748487.653809:0:15194:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19a63 00000020:00000080:2.0:1788748487.653817:0:15194:0:(genops.c:885:class_export_put()) final put ffff8add87c16800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788748487.656450:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8add8f101000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788748487.656466:0:8:0:(genops.c:885:class_export_put()) final put ffff8addb3920000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788748487.656470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3920000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788748487.656482:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788748487.658109:0:15194:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788748487.658121:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748487.658129:0:15194:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788748487.658134:0:15194:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8addaea899c0) has no exports 00000020:00000080:1.0:1788748487.666744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8add87c16800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788748487.710072:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748487.710085:0:15194:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788748487.710091:0:15194:0:(genops.c:885:class_export_put()) final put ffff8adda7356000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788748487.710096:0:15194:0:(genops.c:844:class_export_destroy()) destroying export ffff8adda7356000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788748487.710101:0:15194:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788748487.710221:0:15194:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adda7354000 00000020:02000400:3.0:1788748487.713855:0:15194:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788748488.038452:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748489.078984:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748490.089988:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788748491.045465:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788748491.045474:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788748491.045479:0:8:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748491.045501:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1788748491.045509:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788748491.045537:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8addb3d14000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748491.045567:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8493a680 x1875638388681984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748491.045587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788748491.045591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788748491.045593:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adda719a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748491.045596:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1788748491.045599:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788748491.045603:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8adda719a000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748491.045615:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc84939f80 x1875638388682112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748491.045624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788748491.045628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788748491.045629:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748491.045633:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1788748491.045635:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788748491.045639:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc82c20800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748491.045649:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc84938380 x1875638388682240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748491.045676:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788748491.045679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788748491.045681:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748491.045684:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1788748491.045686:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788748491.045693:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388682624:0@lo:400:kworker.0 00000100:00080000:1.0:1788748491.045697:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc83d29000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748491.045710:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8493ad80 x1875638388682752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748491.045755:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388681856:0@lo:400:kworker.0 00000400:00000100:1.0:1788748491.045781:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875638388681856 offset 0 length 224: 4 00000100:00100000:3.0:1788748491.045785:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748491.045951:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388682496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788748491.046056:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748491.046089:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388682624 00000100:00100000:3.0:1788748491.046106:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388682624 00000100:00100000:3.0:1788748491.046178:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788748491.046189:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388682624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748491.046246:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388682624:12345-0@lo:400:kworker.0 Request processed in 59us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748491.046253:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788748491.046271:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388682880:0@lo:400:kworker.0 00000100:00100000:3.0:1788748491.046281:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388682496 00000100:00100000:3.0:1788748491.046285:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388682496 00000100:00100000:1.0:1788748491.046304:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.046352:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788748491.046358:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388682368:0@lo:400:kworker.0 00000100:00100000:1.0:1788748491.046381:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.046401:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388683008:0@lo:400:kworker.0 00000100:00100000:1.0:1788748491.046423:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.046455:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388681984:0@lo:38:kworker.0 00000100:00100000:1.0:1788748491.046496:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.046519:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388682112:0@lo:38:kworker.0 00000100:00100000:1.0:1788748491.046542:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.046561:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388682240:0@lo:38:kworker.0 00000100:00100000:1.0:1788748491.046585:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.046606:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388682752:0@lo:38:kworker.0 00000100:00100000:1.0:1788748491.046628:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748491.046651:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748491.046657:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388682880 00000100:00100000:1.0:1788748491.046661:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388682880 00000100:00100000:3.0:1788748491.046663:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388682496:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748491.046685:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388682368 00000100:00100000:1.0:1788748491.046687:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388682368 00002000:00000024:3.0:1788748491.046692:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788748491.046700:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388682112 00000100:00100000:1.0:1788748491.046709:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388682112 00000100:00100000:3.0:1788748491.046733:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388682496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748491.046738:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388682240 00000100:00100000:3.0:1788748491.046740:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748491.046741:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388682240 00000100:00100000:1.0:1788748491.046752:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388682752 00000100:00100000:1.0:1788748491.046754:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388682752 00000100:00080000:3.0:1788748491.046758:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788748491.046764:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00080000:3.0:1788748491.046775:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748491.046775:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388682880:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788748491.046777:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748491.046788:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683008 00000100:00100000:3.0:1788748491.046791:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683008 00000100:00100000:1.0:1788748491.046814:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388682880:12345-0@lo:400:kworker.0 Request processed in 43us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748491.046820:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788748491.046824:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788748491.046830:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388683008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748491.046835:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788748491.046840:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388682368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748491.046861:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388683008:12345-0@lo:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748491.046861:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388682368:12345-0@lo:400:kworker.0 Request processed in 22us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748491.046866:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788748491.046867:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788748491.046878:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788748491.046882:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388682112:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788748491.046902:0:6511:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788748491.046933:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388682112:12345-0@lo:38:kworker.0 Request processed in 49us (390us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788748491.046935:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388682496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748491.046939:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788748491.046951:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788748491.046954:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388682240:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788748491.046964:0:6511:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788748491.047001:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388682240:12345-0@lo:38:kworker.0 Request processed in 44us (414us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788748491.047016:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788748491.047028:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788748491.047033:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388682752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788748491.047042:0:6511:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788748491.047066:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875638388682752:12345-0@lo:38:kworker.0 Request processed in 32us (437us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788748491.047072:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788748491.047099:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388681984 00000100:00100000:1.0:1788748491.047103:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388681984 00000100:00100000:1.0:1788748491.047124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788748491.047129:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add884e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875638388681984:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788748491.047139:0:6516:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788748491.047166:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add884e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875638388681984:12345-0@lo:38:kworker.0 Request processed in 36us (670us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788748491.047172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788748491.047515:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388682624:0@lo:400:kworker.0 00000100:00080000:1.0:1788748491.050846:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748491.050865:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788748491.050872:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388681984:0@lo:38:kworker.0 00000100:00080000:1.0:1788748491.050888:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adda719a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748491.050892:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788748491.050895:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388682112:0@lo:38:kworker.0 00000100:00080000:1.0:1788748491.050907:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748491.050911:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788748491.050914:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388682240:0@lo:38:kworker.0 00000100:00080000:1.0:1788748491.050941:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748491.050945:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788748491.050948:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388682752:0@lo:38:kworker.0 00010000:00080000:1.0:1788748491.051013:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8adc84938a80 x1875638388682368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748491.051029:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388682368:0@lo:400:kworker.0 00000100:00100000:1.0:1788748491.051043:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388683008:0@lo:400:kworker.0 00010000:00080000:1.0:1788748491.051056:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8adc8493b100 x1875638388682880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748491.051065:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388682880:0@lo:400:kworker.0 00010000:00010000:0.0:1788748491.122580:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748491.560273:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388683136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748491.560423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748491.560767:0:13586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683136 00000100:00100000:2.0:1788748491.560778:0:13586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683136 00000100:00100000:2.0:1788748491.560843:0:13586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788748491.560855:0:13586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388683136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748491.560897:0:13586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788748491.565293:0:13586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388683136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4423us (4853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748491.565312:0:13586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788748491.572471:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388683136:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1788748491.817065:0:15396:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788748491.846774:0:15396:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788748491.846853:0:15396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748491.846872:0:15396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748491.846881:0:15396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748491.846888:0:15396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748491.846918:0:15396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788748491.846924:0:15396:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788748491.846959:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788748491.846963:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788748491.846971:0:15396:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788748491.846979:0:15396:0:(import.c:65:import_set_state_nolock()) ffff8adda719a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788748491.846986:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788748491.846987:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788748491.847007:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788748491.850356:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748491.850376:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748491.850390:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add839f7c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748491.850396:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748491.850407:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748491.850428:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748491.850435:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788748491.850437:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788748491.850441:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788748491.850504:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748491.850512:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748491.850573:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748491.850581:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add839f7c00/0x9ba0f20a02e19fcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19fd4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748491.850600:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748491.850602:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748491.850604:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748491.850704:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748491.850730:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388683264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748491.850822:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788748491.851099:0:15396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.851110:0:15396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.851118:0:15396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.851127:0:15396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.851144:0:15396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748491.851151:0:15396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.851157:0:15396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.851164:0:15396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748491.851449:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683264 00000100:00100000:2.0:1788748491.851459:0:9515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683264 00000100:00100000:2.0:1788748491.851520:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748491.851530:0:9515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3637:x1875638388683264:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788748491.851537:0:9515:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748491 with bad export cookie 11214229196964469389 00010000:00010000:3.0:1788748491.852304:0:15396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852343:0:15396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788748491.852353:0:15396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852379:0:15396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852386:0:15396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852393:0:15396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852530:0:15396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788748491.852539:0:15396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852547:0:15396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852553:0:15396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748491.852559:0:15396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858278:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788748491.858300:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858327:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748491.858332:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858345:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748491.858352:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748491.858384:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748491.858387:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788748491.858458:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858466:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748491.858514:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858522:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e19fdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19fe2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858547:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748491.858551:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858556:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748491.858559:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858567:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748491.858574:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748491.858578:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748491.858580:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788748491.858583:0:7918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788748491.858605:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858612:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748491.858618:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858624:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb400/0x9ba0f20a02e19ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19eae expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858641:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748491.858645:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858651:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fa400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748491.858653:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858661:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748491.858667:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748491.858673:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788748491.858675:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788748491.858678:0:7918:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788748491.858693:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858699:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748491.858721:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858735:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add813fa400/0x9ba0f20a02e1a235 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e1a23c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858748:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748491.858752:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858758:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add80030400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748491.858761:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858769:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748491.858775:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748491.858780:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748491.858783:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788748491.858795:0:7918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858801:0:7918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748491.858807:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748491.858814:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748491.858816:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748491.858818:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748491.858865:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388683392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748491.858959:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.859031:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748491.859037:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388683520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748491.859068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.859100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388683776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748491.859125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.859136:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748491.859141:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388683648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748491.859160:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.859185:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683392 00000100:00100000:1.0:1788748491.859195:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683392 00000100:00100000:1.0:1788748491.859229:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683520 00000100:00100000:1.0:1788748491.859232:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683520 00000100:00100000:1.0:1788748491.859244:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683776 00000100:00100000:1.0:1788748491.859246:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683776 00000100:00100000:1.0:1788748491.859252:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683648 00000100:00100000:1.0:1788748491.859254:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683648 00000100:00100000:1.0:1788748491.859266:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748491.859274:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add930ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875638388683392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788748491.859281:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748491 with bad export cookie 11214229196964469389 00000100:00100000:1.0:1788748491.859358:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add930ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875638388683392:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (398us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788748491.859365:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788748491.859385:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748491.859388:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875638388683520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788748491.859393:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748491 with bad export cookie 11214229196964469389 00000100:00100000:1.0:1788748491.859413:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875638388683520:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (344us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788748491.859426:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788748491.859437:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748491.859441:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1875638388683776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788748491.859445:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748491 with bad export cookie 11214229196964469389 00000100:00100000:1.0:1788748491.859470:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1875638388683776:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (345us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788748491.859476:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748491.859497:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748491.859501:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1875638388683648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788748491.859505:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788748491 with bad export cookie 11214229196964469389 00000100:00100000:1.0:1788748491.859525:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1875638388683648:12345-0@lo:103:ldlm_bl.0 Request processed in 23us (364us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788748491.859530:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788748491.859561:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788748491.859567:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8add83fbd000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788748491.859571:0:3638:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1788748491.861598:0:9515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3637:x1875638388683264:12345-0@lo:103:ldlm_bl.0 Request processed in 10061us (10769us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788748491.861612:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788748491.861717:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748491.862061:0:15396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788748491.862074:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add80030400/0x9ba0f20a02e19b90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9ba0f20a02e19b97 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748491.862103:0:15396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788748491.862112:0:15396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788748491.862116:0:15396:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1788748491.862616:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748491.862715:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000004:3.0:1788748491.862938:0:15396:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788748491.862943:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788748491.862950:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748491.862957:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788748491.862965:0:15396:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8addbf46c000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788748491.862973:0:15396:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8adc82c27800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788748491.862978:0:15396:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8addb3d64d40) has exports, disconnecting them 00000020:00080000:3.0:1788748491.862984:0:15396:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8addbf46c000), last request at 1788748491 00000020:00000080:3.0:1788748491.862993:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19e6f 00000100:00080000:3.0:1788748491.863009:0:15396:0:(import.c:65:import_set_state_nolock()) ffff8addbf46b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788748491.863057:0:15396:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8addbf46c000): rc 0 00000020:00000080:3.0:1788748491.863060:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addbf46c000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788748491.863079:0:15396:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8adc82c27800), last request at 1788748491 00000020:00000080:3.0:1788748491.863082:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d49 00000100:00080000:3.0:1788748491.863088:0:15396:0:(import.c:65:import_set_state_nolock()) ffff8adc82c21800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788748491.863100:0:15396:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc82c27800): rc 0 00000020:00000080:3.0:1788748491.863102:0:15396:0:(genops.c:885:class_export_put()) final put ffff8adc82c27800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788748491.863111:0:15396:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaf7081c5fae0 00000100:00080000:3.0:1788748491.863136:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788748491.863146:0:15396:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8adc84bbd880 x1875638388679936/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788748499 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748491.863157:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788748491.864024:0:15396:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788748491.864033:0:15396:0:(import.c:65:import_set_state_nolock()) ffff8addb3d14000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788748491.864175:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748491.864183:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748491.871573:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748491.871713:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788748491.871721:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788748491.871749:0:15396:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788748491.871815:0:15396:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788748491.871873:0:15396:0:(import.c:65:import_set_state_nolock()) ffff8addbf46d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788748491.871897:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788748491.871900:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788748491.871912:0:15396:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788748491.871986:0:15396:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788748491.871996:0:15396:0:(import.c:65:import_set_state_nolock()) ffff8addae41e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788748491.872025:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8addb3d64d40) has no exports 00000100:00080000:1.0:1788748491.880134:0:3638:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.122@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788748491.880143:0:3638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788748491.880157:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc8493aa00 x1875638388681856/t0(0) o400->MGC192.168.203.122@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748491.880178:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc843e5180 x1875638388683264/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748491.880188:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc842f8000 x1875638388683392/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748491.880196:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc842faa00 x1875638388683520/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748491.880230:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc842f9180 x1875638388683776/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748491.880239:0:3638:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc842f9c00 x1875638388683648/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788748507 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748491.880555:0:3637:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8add83fbd000 already not connected (conn 1, was 1): DISCONN 00000020:00000080:0.0:1788748491.880644:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf46c000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 10000000:01000000:1.0:1788748491.880712:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788748491.880717:0:3638:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788748491.880718:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788748491.880723:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8add83fbd000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748491.880729:0:3638:0:(import.c:545:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 156 00000020:00000080:0.0:1788748491.880731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82c27800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:1.0:1788748491.880748:0:3638:0:(import.c:666:import_select_connection()) MGC192.168.203.122@tcp: import ffff8add83fbd000 using connection 192.168.203.122@tcp/0@lo 00000020:00000080:0.0:1788748491.880765:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf46b800 for lustre-MDT0001 00000020:00000080:0.0:1788748491.880770:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc82c21800 for lustre-MDT0001 00000100:00100000:0.0:1788748491.880806:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388683520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748491.880816:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388683392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748491.880824:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:27ab3bfa-63dd-419e-978e-87fcee7a537d:3635:1875638388681856:0@lo:400:kworker.0 00000100:00100000:1.0:1788748491.880966:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388683904:0@lo:9:umount.0 00000100:00100000:0.0:1788748491.880992:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8380f800 x1875638388684160/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748491.881013:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388683776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748491.881029:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:27ab3bfa-63dd-419e-978e-87fcee7a537d:3638:1875638388683648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748491.881053:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.881100:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388684032:0@lo:9:umount.0 00000100:00100000:1.0:1788748491.881127:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748491.881159:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388684160:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788748491.881178:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875638388684160 offset 0 length 520: 4 00000100:00100000:1.0:1788748491.881225:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388683904 00000100:00100000:1.0:1788748491.881236:0:8734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388683904 00000100:00100000:0.0:1788748491.881286:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388684032 00000100:00100000:0.0:1788748491.881290:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388684032 00000100:00100000:1.0:1788748491.881292:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788748491.881300:0:8734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1875638388683904:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788748491.881338:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788748491.881345:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875638388684032:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788748491.881363:0:8734:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d96 00000020:00000080:0.0:1788748491.881363:0:8424:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19ed8 00000100:00080000:1.0:1788748491.881374:0:8734:0:(import.c:65:import_set_state_nolock()) ffff8adc82567000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788748491.881374:0:8424:0:(import.c:65:import_set_state_nolock()) ffff8addbf54d000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788748491.881682:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388679936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748491.881709:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:27ab3bfa-63dd-419e-978e-87fcee7a537d:3637:1875638388683264:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788748491.881809:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:1.0:1788748491.882025:0:8734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788748491.882037:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3634:x1875638388684032:12345-0@lo:9:umount.0 Request processed in 691us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748491.882059:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788748491.882186:0:8734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3634:x1875638388683904:12345-0@lo:9:umount.0 Request processed in 885us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748491.882193:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788748491.882430:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addae41e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788748491.882444:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788748491.882447:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748491.882451:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388684032:0@lo:9:umount.0 00000100:00080000:3.0:1788748491.882473:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addbf46d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788748491.882494:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788748491.882496:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748491.882498:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388683904:0@lo:9:umount.0 00010000:00010000:2.0:1788748491.882680:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748491.882680:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788748491.889009:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8addb3d64d40) has no exports 00000020:01000000:2.0:1788748491.942722:0:15396:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adc83bdaf60 - data ffff8adda766f510/ffff8addb52b6000 00000020:01000000:3.0:1788748491.943252:0:15396:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8add855f7900 - data ffff8adda76401b0/ffff8addb3ae0400 00000001:00000004:3.0:1788748491.952710:0:15396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788748492.004434:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788748492.004447:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788748492.004459:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788748492.007673:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788748492.007686:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788748492.007757:0:15396:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748492.007761:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788748492.009714:0:8732:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788748492.009734:0:8732:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788748492.009752:0:8732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788748492.012430:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788748492.012440:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788748492.012502:0:15396:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748492.012506:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788748492.013035:0:10006:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788748492.013042:0:10006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788748492.013133:0:10006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788748492.022257:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19bb3 00000020:00000080:3.0:1788748492.022294:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d5d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788748492.024343:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d5d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788748492.025418:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19bc8 00000020:00000080:3.0:1788748492.025435:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d5a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788748492.025451:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788748492.025457:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.025468:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788748492.025473:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8addb3d60000) has no exports 00000004:01000000:3.0:1788748492.025698:0:15396:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788748492.025710:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19ed1 00000020:00000080:3.0:1788748492.025715:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb53b0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788748492.026015:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d5a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788748492.026232:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788748492.026239:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.026249:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748492.026252:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8adc83b14d40) has no exports 00000020:00000080:3.0:1788748492.026262:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19eca 00000020:00000080:3.0:1788748492.026268:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addae418800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788748492.027637:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb53b0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788748492.027665:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addae418800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788748492.029307:0:15396:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788748492.029341:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788748492.029347:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788748492.029358:0:15396:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748492.029362:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748492.029423:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.029443:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788748492.029454:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d8f 00000020:00000080:3.0:1788748492.029466:0:15396:0:(genops.c:885:class_export_put()) final put ffff8adc82564000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788748492.029473:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788748492.029489:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.029495:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748492.029499:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8addb538cd40) has no exports 00000020:00000080:3.0:1788748492.029508:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d88 00000020:00000080:3.0:1788748492.029512:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addbf46d800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788748492.029829:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addae41e000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788748492.029840:0:38:0:(genops.c:885:class_export_put()) final put ffff8adc82c25800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788748492.029843:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82c25800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788748492.029851:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788748492.030009:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82564000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788748492.030015:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf46d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788748492.030409:0:15396:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788748492.030425:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788748492.030429:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788748492.030433:0:15396:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788748492.030435:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748492.030472:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.030488:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788748492.030512:0:15396:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788748492.030551:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf46d000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788748492.030558:0:38:0:(genops.c:885:class_export_put()) final put ffff8addbf46a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788748492.030561:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf46a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788748492.030565:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788748492.030695:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19beb 00000020:00000080:3.0:1788748492.030703:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d13000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788748492.030716:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788748492.031213:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.031220:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788748492.031226:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8addaea88000) has no exports 00000020:00000080:3.0:1788748492.031233:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19be4 00000020:00000080:3.0:1788748492.031240:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d16800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788748492.031886:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d13000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788748492.032241:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d16800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788748492.066591:0:15396:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788748492.066607:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788748492.066615:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788748492.066629:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748492.066738:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.066762:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788748492.066842:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.066846:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788748492.066862:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d5e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788748492.066869:0:15396:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d5e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788748492.066887:0:15396:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788748492.067083:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addb3d14000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788748492.067094:0:38:0:(genops.c:885:class_export_put()) final put ffff8addb3d15800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788748492.067097:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d15800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788748492.067107:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788748492.067616:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19bcf 00000020:00000080:3.0:1788748492.067627:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d5c000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788748492.067655:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788748492.067660:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.067667:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788748492.067672:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8addb3d619c0) has no exports 00000020:00000080:3.0:1788748492.067711:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.067726:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788748492.067733:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19bd6 00000020:00000080:3.0:1788748492.067738:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d5e800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788748492.067747:0:15396:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8add8f106000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788748492.067751:0:15396:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8add8f106000 2 00000020:01000004:3.0:1788748492.067755:0:15396:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8add8f106000 from lustre-MDT0001 00000020:00000080:3.0:1788748492.067780:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.067784:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788748492.067786:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3d5d800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788748492.067788:0:15396:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d5d800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788748492.067801:0:15396:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788748492.067846:0:15396:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788748492.067851:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788748492.068137:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d5c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788748492.068141:0:38:0:(genops.c:885:class_export_put()) final put ffff8addb3d58000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788748492.068144:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d58000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788748492.068148:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788748492.069698:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.069713:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788748492.069723:0:15396:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8addbc782000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788748492.069730:0:15396:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8addb393cd40) has exports, disconnecting them 00000020:00080000:3.0:1788748492.069735:0:15396:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8addbc782000), last request at 1788748258 00000020:00000080:3.0:1788748492.069740:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19c2a 00000020:00080000:3.0:1788748492.069749:0:15396:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8addbc782000): rc 0 00000020:00000080:3.0:1788748492.069754:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addbc782000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788748492.070295:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3d5e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788748492.070390:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbc782000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788748492.072433:0:15396:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788748492.072447:0:15396:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788748492.072453:0:15396:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788748492.072465:0:15396:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788748492.072863:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adda719a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788748492.072918:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.073003:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788748492.073011:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addae41d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788748492.073015:0:15396:0:(genops.c:844:class_export_destroy()) destroying export ffff8addae41d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788748492.073110:0:15396:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788748492.073214:0:15396:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8add8f106000 1 00000020:00000080:3.0:1788748492.073222:0:15396:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19b66 00000020:00000080:3.0:1788748492.073231:0:15396:0:(genops.c:885:class_export_put()) final put ffff8addb3aae800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788748492.073245:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788748492.073249:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.073255:0:15396:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788748492.073259:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8add9ea60000) has no exports 00000020:00000080:1.0:1788748492.074311:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb3aae800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:2.0:1788748492.307073:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788748492.313736:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.313757:0:15396:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788748492.313764:0:15396:0:(genops.c:885:class_export_put()) final put ffff8add8f100000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788748492.313770:0:15396:0:(genops.c:844:class_export_destroy()) destroying export ffff8add8f100000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788748492.313784:0:15396:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788748492.313931:0:15396:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8add8f102800 00000020:01000000:3.0:1788748492.313956:0:15396:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788748492.313960:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748492.313965:0:15396:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788748492.313970:0:15396:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8addaea8b380) has no exports 00000100:00100000:1.0:1788748492.314301:0:6511:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8add975afa00:6511] 1 exiting: rc = 0 00000100:00100000:3.0:1788748492.314578:0:8447:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8adc82c2c200:8447] 3 exiting: rc = 0 00000100:00100000:3.0:1788748492.314674:0:6510:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8add98b7ec00:6510] 0 exiting: rc = 1 00000100:00100000:3.0:1788748492.314743:0:10244:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8addb5328000:10244] 4 exiting: rc = 0 00000100:00100000:3.0:1788748492.315059:0:6512:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8add975afe00:6512] 2 exiting: rc = 0 00000100:00100000:2.0:1788748492.315173:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315185:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315191:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315212:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315218:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315224:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315229:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315301:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315313:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315384:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315390:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315396:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315402:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315408:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315414:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315420:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315426:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315432:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315439:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315446:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315451:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315457:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315463:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315469:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315484:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315492:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315498:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315504:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315510:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315516:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315522:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315528:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315534:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315540:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315546:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315552:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315558:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315563:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315577:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315583:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315590:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315598:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315604:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315611:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315616:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315621:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315626:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315633:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315638:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315645:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315651:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315658:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315663:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315671:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315676:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315682:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315688:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315694:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315700:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315706:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315713:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315719:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315724:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.315739:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.319650:0:6514:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8add9eac1e00:6514] 1 exiting: rc = 0 00000100:00100000:0.0:1788748492.319849:0:6513:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8add975aee00:6513] 0 exiting: rc = 1 00000100:00100000:3.0:1788748492.319935:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319947:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319954:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319962:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319969:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319975:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319983:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319990:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.319997:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320006:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320031:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320038:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320047:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320052:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320058:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320065:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320071:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320077:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320083:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320089:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320095:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320100:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320107:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320113:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320118:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320124:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320131:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320137:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320143:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320149:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320155:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320160:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320166:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320172:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320178:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320184:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320190:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320197:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320204:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320210:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320216:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320222:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320227:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320233:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320557:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320574:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320580:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320586:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320592:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320597:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320604:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320611:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320617:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320623:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320630:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320635:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320642:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320647:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320655:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320661:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320667:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320673:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320678:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.320684:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.321560:0:7819:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8addbc7f7000:7819] 2 exiting: rc = 0 00000100:00100000:1.0:1788748492.321856:0:6516:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8addba6ebc00:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1788748492.322096:0:6515:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8add9ea9d000:6515] 0 exiting: rc = 1 00000100:00100000:3.0:1788748492.322617:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322629:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322637:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322645:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322651:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322669:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322677:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322684:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322691:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322698:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322704:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322712:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322718:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322725:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322731:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322737:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322762:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322783:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322791:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322798:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322806:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322813:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322820:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322827:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322833:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322840:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322847:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322855:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322864:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322889:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322897:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322903:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322912:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322918:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322926:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322933:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322941:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322947:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322954:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322961:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322967:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322987:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.322996:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323003:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323011:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323018:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323025:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323030:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323037:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323043:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323048:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323064:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323070:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323090:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323099:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323105:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323112:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323120:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323127:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323134:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323143:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323149:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323155:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.323169:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748492.334651:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8add88502e00:6518] 1 exiting: rc = 0 00000100:00100000:0.0:1788748492.335074:0:6517:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8add88503600:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1788748492.335179:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335188:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335194:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335200:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335206:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335212:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335218:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335244:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335250:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335255:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335261:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335267:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335273:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335279:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335285:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335290:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335296:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335302:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335308:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335342:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335350:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335356:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335362:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335368:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335373:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335379:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335385:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335391:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335396:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335401:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335407:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335412:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335418:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335424:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335430:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335436:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335441:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335447:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335452:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335458:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335464:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335469:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335492:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335497:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335502:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335508:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335514:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335520:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335525:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335531:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335537:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335543:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335549:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335554:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335559:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335565:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335570:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335575:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335582:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335587:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335593:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335599:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335605:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.335611:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748492.336108:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8add88503000:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1788748492.336252:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8add88503c00:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1788748492.336466:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336483:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336489:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336495:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336500:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336505:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336512:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336518:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336524:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336529:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336535:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336541:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336547:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336562:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336568:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336574:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336579:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336584:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336591:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336597:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336602:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336607:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336613:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336618:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336624:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336629:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336634:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336639:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336644:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336649:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336654:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336660:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336665:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336671:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336677:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336682:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336688:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336693:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336698:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336704:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336709:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336714:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336720:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336725:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336730:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336736:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336741:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336746:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336760:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336766:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336771:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336776:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336781:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336787:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336792:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336797:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336802:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336807:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336812:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336817:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336822:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336828:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336833:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.336838:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788748492.337633:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8add88410400:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1788748492.338085:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8add884f9000:6522] 1 exiting: rc = 0 00000100:00100000:2.0:1788748492.338187:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338195:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338202:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338209:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338214:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338220:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338227:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338233:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338254:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338260:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338267:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338274:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338280:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338285:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338291:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338296:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338301:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338307:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338313:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338392:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338400:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338405:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338411:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338416:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338422:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338427:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338433:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338438:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338443:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338449:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338454:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338458:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338463:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338468:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338473:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338494:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338499:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338505:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338511:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338517:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338522:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338529:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338535:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338540:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338546:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338551:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338557:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338562:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338567:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338572:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338577:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338583:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338588:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338593:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338606:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338611:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338617:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338623:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338628:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338633:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338638:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338643:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338649:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.338654:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748492.339926:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8add88411600:6524] 1 exiting: rc = 0 00000100:00100000:0.0:1788748492.340568:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8add884f9200:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1788748492.340871:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8add884f9e00:6525] 2 exiting: rc = 0 00000100:00100000:2.0:1788748492.341008:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341019:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341025:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341032:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341038:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341044:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341050:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341056:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341063:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341071:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341077:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341083:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341090:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341096:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341103:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341109:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341116:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341123:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341129:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341136:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341143:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341150:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341156:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341163:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341186:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341211:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341218:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341225:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341233:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341252:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341258:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341265:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341272:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341278:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341284:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341291:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341297:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341304:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341311:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341344:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341351:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341357:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341364:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341370:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341377:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341383:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341389:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341397:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341417:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341425:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341431:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341438:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341444:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341450:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341457:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341463:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341469:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341484:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341491:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341498:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341512:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341519:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341525:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748492.341531:0:15396:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788748492.358558:0:15396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748492.358578:0:15396:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788748492.358586:0:15396:0:(genops.c:885:class_export_put()) final put ffff8add88480000/MDS_uuid 00000020:00000080:3.0:1788748492.358593:0:15396:0:(genops.c:844:class_export_destroy()) destroying export ffff8add88480000/MDS_uuid for MDS 00000020:01000000:3.0:1788748492.358601:0:15396:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788748492.358778:0:15396:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788748493.349375:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748494.373916:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748495.401056:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748496.165266:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788748496.165281:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788748496.165284:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788748496.165289:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788748496.165294:0:38:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748496.165305:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 408 00000100:00080000:3.0:1788748496.165313:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788748496.165347:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc82c20800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748496.165399:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc825c2300 x1875638388684288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748496.165489:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788748496.165493:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788748496.165495:0:38:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748496.165499:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 408 00000100:00080000:3.0:1788748496.165502:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788748496.165507:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc83d29000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748496.165521:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc825c3480 x1875638388684544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748496.165567:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388684672:0@lo:400:kworker.0 00000400:00000100:3.0:1788748496.165635:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388684672 offset 0 length 224: 4 00000100:00100000:3.0:1788748496.165709:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788748496.165717:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388684416:0@lo:400:kworker.0 00000400:00000100:3.0:1788748496.165736:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388684416 offset 0 length 224: 4 00000100:00100000:0.0:1788748496.165828:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388684288:0@lo:38:kworker.0 00000400:00000100:0.0:1788748496.165858:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388684288 offset 0 length 520: 4 00000100:00100000:0.0:1788748496.165882:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388684544:0@lo:38:kworker.0 00000400:00000100:0.0:1788748496.165899:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388684544 offset 0 length 520: 4 00010000:00010000:2.0:1788748496.422264:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748497.153992:0:15597:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788748497.168508:0:15597:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788748497.168586:0:15597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748497.168606:0:15597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748497.168615:0:15597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748497.168622:0:15597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748497.168645:0:15597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788748497.168651:0:15597:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788748497.168687:0:15597:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748497.168703:0:15597:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc825c2300 x1875638388684288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788748516 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748497.168722:0:15597:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788748497.168729:0:15597:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788748497.168738:0:15597:0:(import.c:65:import_set_state_nolock()) ffff8adc82c20800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788748497.168744:0:15597:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748497.168748:0:15597:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc825c2300 x1875638388684288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788748516 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748497.168784:0:15597:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788748497.168788:0:15597:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1788748497.168949:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748497.168958:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748497.168967:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748497.168971:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748497.168982:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748497.168991:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748497.168997:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748497.168999:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788748497.169009:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788748497.169025:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:1.0:1788748497.169030:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748497.169036:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e19fb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19fb8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748497.169048:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748497.169050:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748497.169052:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748497.169217:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388684288:0@lo:38:kworker.0 00000100:00080000:2.0:1788748497.170375:0:15597:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788748497.170394:0:15597:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc825c1180 x1875638388684416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748497.170419:0:15597:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788748497.170426:0:15597:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788748497.170468:0:15597:0:(import.c:65:import_set_state_nolock()) ffff8adc825b8800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788748497.170863:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875638388684800:0@lo:39:umount.0 00000400:00000100:0.0:1788748497.170947:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388684800 offset 0 length 224: 4 00000100:00100000:3.0:1788748497.171140:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388684416:0@lo:400:kworker.0 00010000:00010000:2.0:1788748497.445702:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788748498.214347:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788748498.214360:0:9505:0:(genops.c:885:class_export_put()) final put ffff8addbf54d800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788748498.215163:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788748498.215180:0:8419:0:(genops.c:885:class_export_put()) final put ffff8adc82562000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788748498.215619:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf54d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788748498.215694:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82562000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788748498.215733:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8addbf54d000 for lustre-OST0001 00000020:00000080:0.0:1788748498.215738:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc82567000 for lustre-OST0000 00010000:00010000:2.0:1788748498.469737:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748499.495059:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748500.517312:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748501.284552:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748491/real 1788748491] req@ffff8adc8380f800 x1875638388684160/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788748501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748501.284599:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc8380f800 x1875638388684160/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788748501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788748501.284628:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add83fbd000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748501.284639:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788748501.284644:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388684160:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788748501.284843:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788748501.284849:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788748501.284853:0:38:0:(import.c:65:import_set_state_nolock()) ffff8add83fbd000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748501.284858:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 408 00000100:00080000:2.0:1788748501.284865:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788748501.284881:0:38:0:(import.c:666:import_select_connection()) MGC192.168.203.122@tcp: import ffff8add83fbd000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748501.284920:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e5c00 x1875638388684928/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748501.284946:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788748501.284950:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788748501.285045:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788748501.287544:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388684928:0@lo:250:kworker.0 00000400:00000100:3.0:1788748501.287627:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875638388684928 offset 0 length 520: 4 00000100:00100000:0.0:1788748501.292115:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388685056:0@lo:400:kworker.0 00000400:00000100:0.0:1788748501.292205:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388685056 offset 0 length 224: 4 00010000:00010000:2.0:1788748501.540751:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748502.564586:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748503.588896:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748504.612542:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748505.639578:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788748506.404573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788748506.404586:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748506.404612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788748506.404616:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748506.404711:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748506.404748:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388685184:0@lo:400:kworker.0 00000400:00000100:2.0:1788748506.404821:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388685184 offset 0 length 224: 4 00010000:00010000:2.0:1788748506.661473:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748507.428744:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748497/real 1788748497] req@ffff8adc843e5880 x1875638388684800/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748507 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748507.428784:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e5880 x1875638388684800/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748507 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748507.428801:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc825b8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788748507.428824:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875638388684800:0@lo:39:umount.0 00000100:00080000:2.0:1788748507.429735:0:15597:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788748507.429744:0:15597:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788748507.429752:0:15597:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788748507.431308:0:15597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431368:0:15597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431385:0:15597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431392:0:15597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431429:0:15597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748507.431439:0:15597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431446:0:15597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431475:0:15597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431481:0:15597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748507.431509:0:15597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788748507.431515:0:15597:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1788748507.431782:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748507.431797:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431806:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748507.431810:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431820:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748507.431828:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748507.431834:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788748507.431837:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788748507.431839:0:7918:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788748507.431858:0:7918:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:1.0:1788748507.431863:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431870:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addb3bba800/0x9ba0f20a02e19fbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19fc6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431888:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748507.431891:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431910:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68e00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748507.431913:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431920:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748507.431926:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748507.431932:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788748507.431934:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788748507.431936:0:7918:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788748507.431942:0:7918:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:1.0:1788748507.431945:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431952:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8adc83a68e00/0x9ba0f20a02e1a227 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e1a22e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748507.431961:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748507.431963:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748507.431965:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748507.432143:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748507.433683:0:15597:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788748507.433695:0:15597:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788748507.433708:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748507.433718:0:15597:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788748507.436690:0:15597:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8adc825d4d40) has no exports 00000020:00080000:2.0:1788748507.436950:0:15597:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8adc825d4d40) has no exports 00000020:01000000:2.0:1788748507.446348:0:15597:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adc82cee720 - data ffff8adda770be58/ffff8addb51b8400 00000020:01000000:2.0:1788748507.447029:0:15597:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8add8831d0c0 - data ffff8adda763dbd0/ffff8addbcbb1800 00100000:10000000:2.0:1788748507.490040:0:15597:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788748507.523164:0:15597:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d03 00000020:00000080:2.0:1788748507.523184:0:15597:0:(genops.c:885:class_export_put()) final put ffff8adc825b9000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788748507.523209:0:15597:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8addb53d9000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788748507.523213:0:15597:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8addb53d9000 2 00000020:01000004:2.0:1788748507.523217:0:15597:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8addb53d9000 from lustre-OST0000 00000020:00000080:2.0:1788748507.523262:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748507.523276:0:15597:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788748507.523279:0:15597:0:(genops.c:885:class_export_put()) final put ffff8adc825b8000/lustre-OST0000_UUID 00000020:00000080:2.0:1788748507.523282:0:15597:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc825b8000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788748507.523291:0:15597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788748507.523397:0:15597:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788748507.523403:0:15597:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788748507.523419:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748507.523425:0:15597:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788748507.523433:0:15597:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8adc82c23000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748507.523439:0:15597:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8addb3d63380) has exports, disconnecting them 00000020:00080000:2.0:1788748507.523446:0:15597:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8adc82c23000), last request at 1788748276 00000020:00000080:2.0:1788748507.523451:0:15597:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d2d 00000020:00080000:2.0:1788748507.523464:0:15597:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc82c23000): rc 0 00000020:00000080:2.0:1788748507.523470:0:15597:0:(genops.c:885:class_export_put()) final put ffff8adc82c23000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788748507.524781:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc825b9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788748507.524813:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82c23000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788748507.532458:0:15597:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788748507.532471:0:15597:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748507.532477:0:15597:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788748507.532488:0:15597:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748507.532681:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc82c20800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788748507.532749:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748507.532760:0:15597:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788748507.532768:0:15597:0:(genops.c:885:class_export_put()) final put ffff8adc82c22800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788748507.532773:0:15597:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82c22800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788748507.532923:0:15597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788748507.533018:0:15597:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788748507.533197:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748507.533203:0:15597:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788748507.533212:0:15597:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8adc825bd800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748507.533219:0:15597:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8adc825d19c0) has exports, disconnecting them 00000020:00080000:2.0:1788748507.533225:0:15597:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8adc825bd800), last request at 1788748276 00000020:00000080:2.0:1788748507.533230:0:15597:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19d42 00000020:00080000:2.0:1788748507.533719:0:15597:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc825bd800): rc 0 00000020:00000080:2.0:1788748507.533726:0:15597:0:(genops.c:885:class_export_put()) final put ffff8adc825bd800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788748507.533868:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc825bd800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788748507.536892:0:15597:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788748507.537093:0:15597:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788748507.537099:0:15597:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788748507.537107:0:15597:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788748507.538518:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc825b8800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788748507.538560:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748507.538573:0:15597:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788748507.538579:0:15597:0:(genops.c:885:class_export_put()) final put ffff8adc825bc800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788748507.539463:0:15597:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc825bc800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788748507.539479:0:15597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788748507.539574:0:15597:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8addb53d9000 1 00000020:00000080:3.0:1788748507.539582:0:15597:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19ccb 00000020:00000080:3.0:1788748507.539606:0:15597:0:(genops.c:885:class_export_put()) final put ffff8addb5319800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788748507.539623:0:15597:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788748507.539629:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748507.539637:0:15597:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788748507.539642:0:15597:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8addb39399c0) has no exports 00000020:00000080:3.0:1788748507.544556:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb5319800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788748507.675380:0:15597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788748507.675403:0:15597:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788748507.675412:0:15597:0:(genops.c:885:class_export_put()) final put ffff8addb53df000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788748507.675596:0:15597:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb53df000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788748507.675615:0:15597:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788748507.675874:0:15597:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8addb53da000 00000020:02000400:0.0:1788748507.675936:0:15597:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788748507.684511:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748508.709526:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748509.733026:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748510.756916:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748511.524911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788748511.524925:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788748511.524930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788748511.524945:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748511.525297:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748511.525361:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388685312:0@lo:400:kworker.0 00000400:00000100:2.0:1788748511.525499:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388685312 offset 0 length 224: 4 00010000:00010000:3.0:1788748511.784452:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788748512.489718:0:15799:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788748512.497495:0:15799:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788748512.497633:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.497650:0:15799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.497660:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.497668:0:15799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748512.497700:0:15799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788748512.497707:0:15799:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788748512.497735:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748512.497750:0:15799:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc825c3480 x1875638388684544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788748516 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748512.497774:0:15799:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788748512.497782:0:15799:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788748512.497789:0:15799:0:(import.c:65:import_set_state_nolock()) ffff8adc83d29000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788748512.497796:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788748512.497800:0:15799:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc825c3480 x1875638388684544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788748516 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748512.497808:0:15799:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788748512.497812:0:15799:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:2.0:1788748512.497947:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748512.497956:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748512.497964:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941000 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748512.497969:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748512.497978:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748512.497986:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748512.497992:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788748512.497995:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788748512.497998:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788748512.498014:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:2.0:1788748512.498018:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748512.498024:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc941000/0x9ba0f20a02e19f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19f9c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748512.498048:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748512.498051:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748512.498052:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748512.498106:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388684544:0@lo:38:kworker.0 00000100:00080000:1.0:1788748512.499891:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788748512.499912:0:15799:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc825c2680 x1875638388684672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748512.499996:0:15799:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc843e5180 x1875638388685056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748512.500038:0:15799:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc843e6680 x1875638388685184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748512.500053:0:15799:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc825c1180 x1875638388685312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748527 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748512.500062:0:15799:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788748512.500068:0:15799:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788748512.500099:0:15799:0:(import.c:65:import_set_state_nolock()) ffff8adc83e56800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788748512.503018:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388685184:0@lo:400:kworker.0 00000100:00100000:3.0:1788748512.503095:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875638388685440:0@lo:39:umount.0 00000400:00000100:3.0:1788748512.503161:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875638388685440 offset 0 length 224: 4 00000100:00100000:1.0:1788748512.503794:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875638388685056:0@lo:400:kworker.0 00000100:00100000:2.0:1788748512.507189:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388684672:0@lo:400:kworker.0 00000100:00100000:2.0:1788748512.507231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875638388685312:0@lo:400:kworker.0 00010000:00010000:1.0:1788748512.805306:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748513.828884:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748514.852474:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748515.883895:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748516.580438:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748501/real 1788748501] req@ffff8adc843e5c00 x1875638388684928/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788748516 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748516.580472:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e5c00 x1875638388684928/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788748516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788748516.580492:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add83fbd000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748516.580513:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788748516.580517:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388684928:0@lo:250:kworker.0 00000100:00080000:2.0:1788748516.580613:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788748516.580620:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788748516.580623:0:38:0:(import.c:65:import_set_state_nolock()) ffff8add83fbd000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748516.580629:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 418 00000100:00080000:2.0:1788748516.580635:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.122@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788748516.580647:0:38:0:(import.c:666:import_select_connection()) MGC192.168.203.122@tcp: import ffff8add83fbd000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748516.580679:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e6d80 x1875638388685568/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748516.580740:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388685568:0@lo:250:kworker.0 00000400:00000100:3.0:1788748516.580779:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875638388685568 offset 0 length 520: 4 00010000:00010000:3.0:1788748516.900511:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748517.924469:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748518.949586:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748519.972591:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748520.996463:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788748521.764425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788748521.764436:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788748522.030081:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748522.724501:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748512/real 1788748512] req@ffff8adc842f8e00 x1875638388685440/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748522 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748522.724534:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc842f8e00 x1875638388685440/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788748522 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788748522.724554:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc83e56800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788748522.724575:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875638388685440:0@lo:39:umount.0 00000100:00080000:1.0:1788748522.724702:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788748522.724706:0:15799:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788748522.724711:0:15799:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788748522.725821:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.725838:0:15799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.725844:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.725851:0:15799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.725923:0:15799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748522.725940:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.725947:0:15799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.725954:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748522.725960:0:15799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732374:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788748522.732389:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732401:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba600 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748522.732406:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732417:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748522.732425:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748522.732431:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788748522.732434:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788748522.732450:0:7918:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:3.0:1788748522.732454:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732461:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addb3bba600/0x9ba0f20a02e19fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19faa expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732479:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748522.732483:0:7918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732488:0:7918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68800 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:3.0:1788748522.732491:0:7918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732520:0:7918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788748522.732527:0:7918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748522.732532:0:7918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788748522.732534:0:7918:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788748522.732539:0:7918:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:3.0:1788748522.732541:0:7918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748522.732547:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748522.732549:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748522.732551:0:7918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748522.733284:0:15799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788748522.733293:0:15799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8adc83a68800/0x9ba0f20a02e1a219 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e1a220 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748522.733311:0:15799:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788748522.733350:0:15799:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788748522.733354:0:15799:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788748522.733386:0:15799:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788748522.733390:0:15799:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788748522.733398:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788748522.733403:0:15799:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788748522.733406:0:15799:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8adc83b10000) has no exports 00000020:00080000:1.0:1788748522.733429:0:15799:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8adc83b10000) has no exports 00000020:01000000:1.0:1788748522.735124:0:15799:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adc83e904e0 - data ffff8adda7567e58/ffff8adc84032000 00000020:01000000:1.0:1788748522.735241:0:15799:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8adc82cee4e0 - data ffff8adda7568288/ffff8adc825c5400 00010000:00010000:2.0:1788748522.735859:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788748522.752502:0:15799:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788748522.761133:0:15799:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19e29 00000020:00000080:1.0:1788748522.761145:0:15799:0:(genops.c:885:class_export_put()) final put ffff8adc82c22000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788748522.761163:0:15799:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc838be800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788748522.761175:0:15799:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc838be800 2 00000020:01000004:1.0:1788748522.761178:0:15799:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8adc838be800 from lustre-OST0001 00000020:00000080:1.0:1788748522.761200:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788748522.761208:0:15799:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788748522.761212:0:15799:0:(genops.c:885:class_export_put()) final put ffff8adc82c21000/lustre-OST0001_UUID 00000020:00000080:1.0:1788748522.761214:0:15799:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82c21000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788748522.761221:0:15799:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788748522.761364:0:15799:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 27ab3bfa-63dd-419e-978e-87fcee7a537d->MGS 00010000:00010000:1.0:1788748522.761380:0:15799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add80031c00/0x9ba0f20a02e19b82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e19b89 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748522.761393:0:15799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add80031c00/0x9ba0f20a02e19b82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e19b89 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748522.761400:0:15799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788748522.761402:0:15799:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788748522.761406:0:15799:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00000020:00000080:2.0:1788748522.761613:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc82c22000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:1.0:1788748522.761672:0:15799:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:1.0:1788748522.761677:0:15799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add80031c00/0x9ba0f20a02e19b82 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e19b89 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748522.766432:0:15799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9ba0f20a02e1a00c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748522.766457:0:15799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9ba0f20a02e1a00c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748522.766464:0:15799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788748522.766467:0:15799:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788748522.766470:0:15799:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788748522.766501:0:15799:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8add83fbd000 00010000:00010000:2.0:1788748522.766506:0:15799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addb3bbaa00/0x9ba0f20a02e1a005 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9ba0f20a02e1a00c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788748522.766528:0:15799:0:(import.c:65:import_set_state_nolock()) ffff8add83fbd000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788748522.766533:0:15799:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788748522.766535:0:15799:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788748522.766537:0:15799:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788748522.766542:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788748522.766552:0:15799:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8adc843e6d80 x1875638388685568/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788748536 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788748522.766565:0:15799:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788748522.766568:0:15799:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1788748522.766595:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:27ab3bfa-63dd-419e-978e-87fcee7a537d:3634:1875638388685568:0@lo:250:kworker.0 10000000:01000000:2.0:1788748522.766629:0:15799:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788748522.766639:0:15799:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19a7f 00000020:00000080:2.0:1788748522.766646:0:15799:0:(genops.c:885:class_export_put()) final put ffff8add88484800/27ab3bfa-63dd-419e-978e-87fcee7a537d 00000020:01000000:2.0:1788748522.766667:0:15799:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.122@tcp (flags='') 00000020:00000080:2.0:1788748522.766672:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748522.766680:0:15799:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.122@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788748522.766684:0:15799:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8add9ea619c0) has no exports 00000020:00000080:3.0:1788748522.766706:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8add88484800/27ab3bfa-63dd-419e-978e-87fcee7a537d for MGC192.168.203.122@tcp 10000000:01000000:2.0:1788748522.766719:0:6507:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788748522.766735:0:15799:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.122@tcp: client import never connected 00000100:00080000:3.0:1788748522.766738:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788748522.766740:0:15799:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788748522.766743:0:15799:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788748522.766745:0:15799:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788748522.766770:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8add83fbd000 for MGC192.168.203.122@tcp 00000020:00000080:3.0:1788748522.766806:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788748522.766812:0:15799:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.122@tcp (uuid 27ab3bfa-63dd-419e-978e-87fcee7a537d) 00000020:00000080:3.0:1788748522.766814:0:15799:0:(genops.c:885:class_export_put()) final put ffff8add83fba000/27ab3bfa-63dd-419e-978e-87fcee7a537d 00000020:00000080:3.0:1788748522.766817:0:15799:0:(genops.c:844:class_export_destroy()) destroying export ffff8add83fba000/27ab3bfa-63dd-419e-978e-87fcee7a537d for MGC192.168.203.122@tcp 00000020:01000000:3.0:1788748522.766822:0:15799:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.122@tcp (27ab3bfa-63dd-419e-978e-87fcee7a537d) 00000020:01000000:3.0:1788748522.767081:0:15799:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788748522.767085:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788748522.767089:0:15799:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788748522.767094:0:15799:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8adc83d2e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788748522.767099:0:15799:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8adc825d3380) has exports, disconnecting them 00000020:00080000:3.0:1788748522.767103:0:15799:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8adc83d2e800), last request at 1788748296 00000020:00000080:3.0:1788748522.767108:0:15799:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19e53 00000020:00080000:3.0:1788748522.767118:0:15799:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc83d2e800): rc 0 00000020:00000080:3.0:1788748522.767121:0:15799:0:(genops.c:885:class_export_put()) final put ffff8adc83d2e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788748522.767153:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83d2e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788748522.770810:0:15799:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788748522.770819:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788748522.770824:0:15799:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788748522.770831:0:15799:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788748522.771054:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748522.771345:0:15799:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788748522.771354:0:15799:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788748522.771359:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748522.771364:0:15799:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788748522.771372:0:15799:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8adc83e51800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788748522.771390:0:15799:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8adc825d0000) has exports, disconnecting them 00000020:00080000:2.0:1788748522.771395:0:15799:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8adc83e51800), last request at 1788748296 00000020:00000080:2.0:1788748522.771399:0:15799:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19e68 00000020:00080000:2.0:1788748522.771414:0:15799:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8adc83e51800): rc 0 00000020:00000080:2.0:1788748522.771419:0:15799:0:(genops.c:885:class_export_put()) final put ffff8adc83e51800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788748522.771616:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83d29000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788748522.771626:0:8:0:(genops.c:885:class_export_put()) final put ffff8adc83d2d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788748522.771629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83d2d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788748522.771635:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788748522.771700:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83e51800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788748522.786825:0:15799:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788748522.786833:0:15799:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788748522.786838:0:15799:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788748522.786848:0:15799:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788748522.786957:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8adc83e56800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788748522.786976:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788748522.801586:0:7918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788748522.803359:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788748522.803887:0:6494:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8addba6d5600:6494] 1 exiting: rc = 0 00000100:00100000:1.0:1788748522.803943:0:6493:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8adda730f200:6493] 0 exiting: rc = 1 00000100:00100000:2.0:1788748522.804032:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.804783:0:6496:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8addba6b8200:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1788748522.804809:0:6497:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8addaeaf1800:6497] 2 exiting: rc = 0 00000100:00100000:1.0:1788748522.804907:0:6495:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8add90799800:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1788748522.804992:0:9515:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8adc825ace00:9515] 3 exiting: rc = 0 00000100:00100000:2.0:1788748522.805213:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805222:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805229:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805234:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805239:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805244:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805249:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805255:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805260:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805265:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805279:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805285:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805290:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805296:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805302:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805308:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805436:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805446:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805452:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805458:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805466:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805480:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805484:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805489:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805759:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805768:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805773:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805779:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805784:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805789:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805795:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805801:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805807:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805811:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805817:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805822:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805827:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805832:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805837:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805842:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805847:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805852:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805857:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805862:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805867:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805872:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805877:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805882:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805887:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805892:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805897:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805903:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805908:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805912:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805917:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805922:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805938:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805943:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805948:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805954:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805959:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805964:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805969:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.805981:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788748522.807034:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748522.807044:0:15799:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788748522.807050:0:15799:0:(genops.c:885:class_export_put()) final put ffff8adc83d2d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788748522.807055:0:15799:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc83d2d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788748522.807074:0:15799:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788748522.807122:0:15799:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc838be800 1 00000020:00000080:2.0:1788748522.807127:0:15799:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x9ba0f20a02e19df8 00000020:00000080:2.0:1788748522.807133:0:15799:0:(genops.c:885:class_export_put()) final put ffff8addbf46f000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788748522.807221:0:15799:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788748522.807226:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748522.807231:0:15799:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788748522.807235:0:15799:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8addb538b380) has no exports 00000020:00000080:1.0:1788748522.809912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8addbf46f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788748522.838535:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748522.838549:0:15799:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788748522.838554:0:15799:0:(genops.c:885:class_export_put()) final put ffff8adc838b9800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788748522.838559:0:15799:0:(genops.c:844:class_export_destroy()) destroying export ffff8adc838b9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788748522.838565:0:15799:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788748522.838957:0:15799:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8adc838be000 00000020:01000000:2.0:1788748522.839049:0:15799:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788748522.839054:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788748522.839059:0:15799:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788748522.839063:0:15799:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8add9ea64d40) has no exports 00000020:00000080:2.0:1788748522.839136:0:15799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788748522.839143:0:15799:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788748522.839146:0:15799:0:(genops.c:885:class_export_put()) final put ffff8addb531f800/OSS_uuid 00000020:00000080:2.0:1788748522.839160:0:15799:0:(genops.c:844:class_export_destroy()) destroying export ffff8addb531f800/OSS_uuid for OSS 00000020:01000000:2.0:1788748522.839164:0:15799:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788748522.839304:0:8424:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8add8f18e200:8424] 0 exiting: rc = 1 00000100:00100000:0.0:1788748522.839518:0:8734:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8adc825aba00:8734] 3 exiting: rc = 0 00000100:00080000:3.0:1788748522.839624:0:6506:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788748522.839848:0:8427:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8addb50de600:8427] 2 exiting: rc = 0 00000100:00100000:1.0:1788748522.839930:0:8425:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8addba6d1200:8425] 1 exiting: rc = 0 00000100:00100000:2.0:1788748522.840456:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840465:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840472:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840485:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840492:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840498:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840503:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840509:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840515:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840520:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840526:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840531:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840537:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840542:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840547:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840560:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840567:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840572:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840577:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840582:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840587:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840591:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840595:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840600:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840605:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840610:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840614:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840620:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840703:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840711:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840717:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840723:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840738:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840744:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840748:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840754:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840759:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840763:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840768:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840774:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840779:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840784:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840789:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840795:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840799:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840805:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840810:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840815:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840821:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840826:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840831:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840836:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840841:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840846:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840851:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840857:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840862:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840867:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840872:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840878:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840883:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840888:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840893:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.840899:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748522.842193:0:8429:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8addb50de800:8429] 1 exiting: rc = 0 00000100:00100000:0.0:1788748522.842300:0:13586:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8adc84075000:13586] 2 exiting: rc = 0 00000100:00100000:3.0:1788748522.842474:0:8428:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8addb50dec00:8428] 0 exiting: rc = 1 00000100:00100000:2.0:1788748522.842563:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842570:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842576:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842591:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842595:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842600:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842604:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842610:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842615:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842619:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842624:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842641:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842647:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842652:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842657:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842662:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842668:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842673:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842679:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842684:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842689:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842694:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842813:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842822:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842826:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842831:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842836:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842841:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842846:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842851:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842856:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842862:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842867:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842872:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842876:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842882:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842887:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842892:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842905:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842909:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842914:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842919:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842924:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842930:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842934:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842939:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842944:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842950:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842955:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.842960:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843033:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843038:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843043:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843048:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843053:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843071:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843080:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843086:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843091:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843097:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843101:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843106:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843112:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.843118:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748522.844291:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8addb3d44400:8432] 2 exiting: rc = 0 00000100:00100000:0.0:1788748522.844559:0:8430:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8addb3d44600:8430] 0 exiting: rc = 1 00000100:00100000:3.0:1788748522.844900:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8addb3d44a00:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1788748522.845144:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845152:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845158:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845163:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845176:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845183:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845189:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845194:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845199:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845213:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845218:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845224:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845230:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845253:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845260:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845266:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845286:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845291:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845297:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845303:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845308:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845599:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845607:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845611:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845616:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845621:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845708:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845716:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845720:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845726:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845731:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845735:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845741:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845745:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845751:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845755:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845760:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845780:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845786:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845791:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845795:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845801:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845805:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845810:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845824:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845830:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845835:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845841:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845846:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845852:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845858:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845863:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845869:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845875:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845880:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845886:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845891:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845897:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845903:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845909:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845915:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845922:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845928:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.845933:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788748522.851043:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8addbc738200:8434] 1 exiting: rc = 0 00000100:00100000:0.0:1788748522.851285:0:8735:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff8adc825aa600:8735] 2 exiting: rc = 0 00000100:00100000:1.0:1788748522.851752:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8addb3d45600:8433] 0 exiting: rc = 1 00000100:00100000:2.0:1788748522.852196:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852205:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852209:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852215:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852220:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852225:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852230:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852235:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852241:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852246:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852251:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852256:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852261:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852266:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852281:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852298:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852496:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852501:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852506:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852510:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852515:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852519:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852524:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852529:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852534:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852538:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852542:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852547:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852551:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852556:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852560:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852565:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852570:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852575:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852580:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852584:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852588:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852593:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852597:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852602:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852607:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852611:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852616:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852621:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852635:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852641:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852646:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852651:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852657:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852662:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852674:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852679:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852684:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852688:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852693:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852697:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852702:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852707:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852712:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852716:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852721:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852727:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852732:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.852737:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788748522.854025:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8addbc739600:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1788748522.854164:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8add884f9600:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1788748522.854291:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854560:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854569:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854575:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854580:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854586:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854591:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854596:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854601:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854607:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854612:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854617:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854622:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854652:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854658:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854663:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854669:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854674:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854679:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854685:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854690:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854705:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854712:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854718:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854725:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854744:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854752:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854757:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854764:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854771:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854777:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854783:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854789:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854796:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854802:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854808:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854816:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854837:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854844:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854850:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854856:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854862:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854868:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854873:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854878:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854884:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854888:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854894:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854899:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854919:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854926:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854932:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854937:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854943:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854948:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.854954:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855146:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855153:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855159:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855166:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855171:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855178:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855184:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788748522.855198:0:15799:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788748522.862155:0:15799:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788748542.903824:0:16565:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788748553.014929:0:17164:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788748553.014934:0:17164:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788748553.014936:0:17164:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788748553.015049:0:17164:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adc848d0800 00000020:01000004:3.0:1788748553.015065:0:17164:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788748553.015377:0:17164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788748553.015392:0:17164:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8adc840fcd40) 00000020:00000080:3.0:1788748553.015408:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788748553.096972:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.100158:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788748553.102165:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788748553.103715:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.103938:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.104173:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.104496:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.104683:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.105118:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.106172:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.106843:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.107457:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.107774:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.108011:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.108288:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.108966:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.109330:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.109625:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.109885:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.110176:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.110583:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.110836:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.111128:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788748553.111468:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788748553.111746:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788748553.114416:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788748553.114884:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788748553.115130:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788748553.115511:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788748553.115820:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788748553.116111:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788748553.116735:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788748553.117135:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788748553.117465:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788748553.117981:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788748553.119495:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788748553.119927:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788748553.120186:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.120498:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788748553.120716:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.120996:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788748553.121271:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.122058:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.122384:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788748553.122627:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.122876:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788748553.123171:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.123933:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.124839:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.125238:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.126274:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.126567:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788748553.126886:0:17164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788748553.127710:0:17164:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788748553.127918:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788748553.127927:0:17164:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788748553.127936:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b02e 00000020:01000004:2.0:1788748553.127942:0:17164:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788748553.127947:0:17164:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788748553.127952:0:17164:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc848d0800 from MGS 00000020:01000004:2.0:1788748553.127955:0:17164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788748553.127964:0:17164:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8addb538b380) 00000020:00000080:2.0:1788748553.127973:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788748553.128028:0:17164:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc848d0800 from MGS, refs=2 00080000:01000000:2.0:1788748553.128033:0:17164:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788748553.130051:0:17164:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b03c 00000100:00100000:3.0:1788748553.130217:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788748553.130496:0:17164:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788748553.130502:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788748553.131630:0:17164:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788748553.131649:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788748553.132788:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748553.132962:0:17164:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788748553.132967:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788748553.134390:0:17164:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788748553.134402:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788748553.136184:0:17164:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788748553.136195:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788748553.137352:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748553.137356:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748553.137358:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748553.137867:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748553.137869:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748553.137871:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748553.138435:0:17164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788748553.141383:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788748553.149010:0:17164:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788748553.151477:0:17176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788748553.151538:0:17164:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788748553.151590:0:17164:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788748553.154680:0:17164:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788748553.155148:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748553.156523:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788748553.156532:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788748553.159297:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788748553.159308:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788748553.160175:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788748553.160184:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788748553.160999:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788748553.161018:0:17164:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:3.0:1788748553.161020:0:17164:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788748553.161051:0:17164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:3.0:1788748553.161064:0:17164:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (ffff8adc840f99c0) 00000020:00000080:3.0:1788748553.161089:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788748553.161171:0:17164:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8addb3aa9800@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788748553.161532:0:17164:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:3.0:1788748553.161539:0:17164:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788748553.164044:0:17181:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788748553.164196:0:17182:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788748553.165674:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid f35c4edf-1df7-4d0c-8881-06ee23716a92) 00000020:00000080:3.0:1788748553.165748:0:17164:0:(genops.c:1384:class_connect()) connect: client f35c4edf-1df7-4d0c-8881-06ee23716a92, cookie 0x9ba0f20a02e1b04a 00000100:00080000:3.0:1788748553.165823:0:17164:0:(import.c:545:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788748553.165836:0:17164:0:(import.c:666:import_select_connection()) MGC192.168.203.122@tcp: import ffff8addb3aa9800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748553.165868:0:17164:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc825c0a80 x1875638388685696/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748553.165939:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f35c4edf-1df7-4d0c-8881-06ee23716a92:3634:1875638388685696:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788748553.168567:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.168679:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388685696 00000100:00100000:0.0:1788748553.168697:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388685696 00000100:00100000:0.0:1788748553.168738:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748553.168746:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1875638388685696:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788748553.168783:0:17177:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from f35c4edf-1df7-4d0c-8881-06ee23716a92@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1788748553.168810:0:17177:0:(genops.c:1384:class_connect()) connect: client f35c4edf-1df7-4d0c-8881-06ee23716a92, cookie 0x9ba0f20a02e1b051 00000100:00080000:0.0:1788748553.168940:0:17177:0:(import.c:65:import_set_state_nolock()) ffff8adc848cb000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788748553.170055:0:17164:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f35c4edf-1df7-4d0c-8881-06ee23716a92->MGS 00000020:01000004:3.0:1788748553.170097:0:17164:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788748553.170104:0:17164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788748553.170120:0:17164:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8adc840fb380) 00000020:00000080:3.0:1788748553.170139:0:17164:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788748553.175573:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+5:3634:x1875638388685696:12345-0@lo:250:mount.lustre.0 Request processed in 6817us (7001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.175588:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748553.179867:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748553.180063:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748553.180515:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788748553.180537:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788748553.180550:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:2.0:1788748553.180560:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788748553.180565:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788748553.180569:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3aa9800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788748553.180572:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788748553.180589:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788748553.180598:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f35c4edf-1df7-4d0c-8881-06ee23716a92:3634:1875638388685696:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788748553.182504:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748553.182516:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788748553.182983:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788748553.182991:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788748553.184047:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748553.184231:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788748553.184237:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788748553.185127:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788748553.185135:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788748553.227719:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748553.228023:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788748553.228031:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788748553.229096:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788748553.229105:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788748553.229882:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748553.230052:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788748553.230064:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788748553.232567:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748553.232580:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788748553.233201:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748553.233391:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788748553.233396:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788748553.233863:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748553.233871:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788748553.234637:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788748553.234794:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788748553.234800:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788748553.235429:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788748553.235437:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788748553.251299:0:17164:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748553.254031:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788748553.254052:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788748553.256080:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788748553.256091:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788748553.257135:0:17164:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788748553.257145:0:17164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788748553.265865:0:17164:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788748553.265895:0:17164:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788748553.265901:0:17164:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788748553.266002:0:17164:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788748553.266036:0:17164:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788748553.266041:0:17164:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788748553.266042:0:17164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748553.266044:0:17164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748553.266045:0:17164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748553.266046:0:17164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748553.266048:0:17164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748553.266049:0:17164:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748553.266051:0:17164:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748553.266052:0:17164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748553.266054:0:17164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748553.266056:0:17164:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788748553.266059:0:17164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748553.266060:0:17164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748553.266061:0:17164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748553.266062:0:17164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748553.266063:0:17164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748553.266074:0:17164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748553.266075:0:17164:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748553.266083:0:17164:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748553.266084:0:17164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748553.266085:0:17164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748553.266111:0:17164:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788748553.266130:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388685824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788748553.266207:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.266268:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91e156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748553.266360:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388685824 00000100:00100000:1.0:1788748553.266369:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388685824 00000100:00100000:1.0:1788748553.266410:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748553.266419:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+5:17164:x1875638388685824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788748553.266463:0:17180:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788748553.266466:0:17180:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788748553.266469:0:17180:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788748553.266790:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788748553.268286:0:17180:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788748553.273750:0:17202:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788748553.273767:0:17202:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788748553.273770:0:17202:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788748553.273773:0:17202:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788748553.274180:0:17202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788748553.274415:0:17180:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788748553.274427:0:17180:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788748553.277515:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+5:17164:x1875638388685824:12345-0@lo:253:mount.lustre.0 Request processed in 11087us (11298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748553.277529:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748553.277658:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388685824:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788748553.277673:0:17164:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788748553.277676:0:17164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748553.277678:0:17164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788748553.277679:0:17164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748553.277680:0:17164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748553.277681:0:17164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748553.277683:0:17164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748553.277684:0:17164:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748553.277686:0:17164:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788748553.277687:0:17164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748553.277689:0:17164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788748553.277707:0:17164:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc848d0800 from lustre-MDT0000 10000000:01000000:3.0:1788748553.277738:0:17164:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788748553.277741:0:17164:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788748553.277746:0:17164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8adc840f99c0 10000000:01000000:3.0:1788748553.277750:0:17164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748553.277758:0:17164:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8adc840f99c0 from 1 10000000:01000000:3.0:1788748553.277762:0:17164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788748553.277798:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.277810:0:17164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.277820:0:17164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748553.277857:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388685952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748553.277892:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.277975:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91e15f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748553.278421:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388685952 00000100:00100000:0.0:1788748553.278428:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388685952 00000100:00100000:0.0:1788748553.278469:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748553.278479:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+5:17164:x1875638388685952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748553.278491:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748553.278508:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941e00/0x9ba0f20a02e1b066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b05f expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.278530:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941e00/0x9ba0f20a02e1b066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b05f expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.278540:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941e00/0x9ba0f20a02e1b066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b05f expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.278561:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941e00, rc 0) 00000100:00100000:0.0:1788748553.278654:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+6:17164:x1875638388685952:12345-0@lo:101:mount.lustre.0 Request processed in 177us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.278662:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748553.278725:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388685952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748553.278741:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.278752:0:17164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748553.278874:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748553.278901:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.278966:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91e15f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748553.279009:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388686080 00000100:00100000:1.0:1788748553.279013:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388686080 00000100:00100000:1.0:1788748553.279089:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748553.279098:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+6:17164:x1875638388686080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748553.279380:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+6:17164:x1875638388686080:12345-0@lo:501:mount.lustre.0 Request processed in 283us (478us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788748553.279394:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748553.279473:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686080:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788748553.279712:0:17164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788748553.279734:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.279744:0:17164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748553.279753:0:17164:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc848d0800 10000000:01000000:2.0:1788748553.279759:0:17164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788748553.279763:0:17164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8adc848d0800 10000000:01000000:2.0:1788748553.279766:0:17164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788748553.279769:0:17164:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8adc848d0800 from 1 10000000:01000000:2.0:1788748553.279772:0:17164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788748553.279796:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bdc00/0x9ba0f20a02e1b06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.279804:0:17164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add912bdc00/0x9ba0f20a02e1b06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.279812:0:17164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add912bdc00/0x9ba0f20a02e1b06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748553.279826:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748553.279866:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748553.279910:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83f9a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748553.280102:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388686208 00000100:00100000:0.0:1788748553.280107:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388686208 00000100:00100000:0.0:1788748553.280143:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748553.280152:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+6:17164:x1875638388686208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748553.280178:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748553.280192:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1b074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b06d expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.280213:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1b074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b06d expref: 7 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.280224:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940c00/0x9ba0f20a02e1b074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b06d expref: 7 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.280231:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940c00, rc 0) 00000100:00100000:0.0:1788748553.280279:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+7:17164:x1875638388686208:12345-0@lo:101:mount.lustre.0 Request processed in 128us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.280286:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748553.280444:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748553.280458:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add912bdc00/0x9ba0f20a02e1b06d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b074 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.280467:0:17164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add912bdc00/0x9ba0f20a02e1b06d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b074 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748553.280481:0:17164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788748553.280498:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bdc00/0x9ba0f20a02e1b06d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b074 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.280517:0:17164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add912bdc00/0x9ba0f20a02e1b06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b074 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748553.280523:0:17164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788748553.280527:0:17164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748553.280532:0:17164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8adc848d0800 10000000:01000000:3.0:1788748553.280535:0:17164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788748553.280538:0:17164:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788748553.280540:0:17164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788748553.280556:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e1b07b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.280564:0:17164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e1b07b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.280571:0:17164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e1b07b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748553.280584:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748553.280610:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.280635:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91e15f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788748553.280955:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388686336 00000100:00100000:1.0:1788748553.280961:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388686336 00000100:00100000:1.0:1788748553.280999:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748553.281008:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+7:17164:x1875638388686336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748553.281016:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748553.281028:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a69a00/0x9ba0f20a02e1b082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b07b expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.281044:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a69a00/0x9ba0f20a02e1b082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b07b expref: 8 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.281054:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a69a00/0x9ba0f20a02e1b082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b07b expref: 8 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.281061:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69a00, rc 0) 00000100:00100000:1.0:1788748553.281104:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+8:17164:x1875638388686336:12345-0@lo:101:mount.lustre.0 Request processed in 98us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748553.281109:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748553.281273:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748553.281285:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e1b07b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b082 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.281293:0:17164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e1b07b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b082 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748553.281406:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748553.281435:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.281453:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91e15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748553.281518:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388686464 00000100:00100000:2.0:1788748553.281523:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388686464 00000100:00100000:2.0:1788748553.281555:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748553.281562:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+8:17164:x1875638388686464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748553.281692:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17164:x1875638388686464:12345-0@lo:501:mount.lustre.0 Request processed in 131us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748553.281698:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748553.281952:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748553.281982:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748553.282024:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.282057:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91e15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748553.282259:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388686592 00000100:00100000:2.0:1788748553.282265:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388686592 00000100:00100000:2.0:1788748553.282290:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748553.282298:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17164:x1875638388686592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748553.283044:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17164:x1875638388686592:12345-0@lo:503:mount.lustre.0 Request processed in 742us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748553.283053:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748553.283152:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388686592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748553.283730:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17203:1875638388686720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748553.283841:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.283881:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91e15180 going to sleep for 11 seconds 00000100:00100000:1.0:1788748553.283937:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388686720 00000100:00100000:1.0:1788748553.283943:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388686720 00000100:00100000:1.0:1788748553.283980:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748553.283988:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17203:x1875638388686720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788748553.284684:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17203:x1875638388686720:12345-0@lo:502:llog_process_th.0 Request processed in 695us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748553.284693:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748553.284792:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17203:1875638388686720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788748553.284820:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748553.284832:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748553.284835:0:17203:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788748553.284841:0:17203:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788748553.284843:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748553.284859:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8adc840f8000) 00000020:00000080:3.0:1788748553.284876:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788748553.284883:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788748553.284967:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788748553.284974:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b090 00000020:00000080:3.0:1788748553.285914:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788748553.285923:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748553.285928:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748553.285939:0:17203:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788748553.285943:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748553.285948:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748553.285949:0:17203:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788748553.285953:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748553.285965:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8addb3d63380) 00000020:00000080:3.0:1788748553.285982:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788748553.285986:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788748553.285988:0:17203:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788748553.285991:0:17203:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788748553.285998:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788748553.286050:0:17203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc848d0800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788748553.286074:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8addb3d619c0) 00000020:00000080:3.0:1788748553.286083:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788748553.286144:0:17203:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788748553.286151:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e1b0a5 00000020:00000080:0.0:1788748553.292212:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788748553.292228:0:17203:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788748553.292241:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9ba0f20a02e1b0ac 00080000:01000000:0.0:1788748553.292252:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788748553.292256:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b0b3 00010000:00010000:3.0:1788748553.406976:0:17203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788748553.408269:0:17203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788748553.412123:0:17203:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788748553.412609:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8addb53899c0) 00000020:00000080:2.0:1788748553.412628:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788748553.412710:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788748553.412719:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b0c1 00000020:00000080:2.0:1788748553.416292:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788748553.423398:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9ba0f20a02e1b0c8 00000020:00000080:2.0:1788748553.424454:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788748553.424468:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748553.424474:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.424476:0:17203:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788748553.424480:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788748553.424489:0:17203:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788748553.424491:0:17203:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788748553.424493:0:17203:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788748553.424494:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788748553.424497:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.424499:0:17203:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788748553.424501:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748553.424506:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.424508:0:17203:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788748553.424512:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788748553.424554:0:17203:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788748553.424569:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748553.424573:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.424575:0:17203:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788748553.424577:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748553.424580:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.424581:0:17203:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788748553.424584:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788748553.424589:0:17203:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:2.0:1788748553.424614:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788748553.424631:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8addb5388000) 00000020:00000080:2.0:1788748553.424646:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788748553.424652:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788748553.424704:0:17203:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788748553.424710:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788748553.424716:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b0d6 00010000:00080000:2.0:1788748553.424746:0:17203:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8addb3926000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788748553.426417:0:17203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788748553.433563:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788748553.433590:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788748553.433630:0:17203:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788748553.433651:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e1b0dd 00000100:00080000:1.0:1788748553.433661:0:17203:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748553.433673:0:17203:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8addb3926000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748553.433711:0:17203:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842fa300 x1875638388686848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748553.433742:0:17203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788748553.433881:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388686848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788748553.433947:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.434023:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388686848 00000100:00100000:3.0:1788748553.434030:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388686848 00000100:00100000:3.0:1788748553.434058:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748553.434075:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875638388686848:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788748553.434089:0:17190:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:1.0:1788748553.435643:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748553.435651:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748553.435653:0:17203:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788748553.435657:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788748553.435660:0:17203:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788748553.435662:0:17203:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748553.435663:0:17203:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748553.435665:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788748553.435668:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748553.435669:0:17203:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788748553.435672:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748553.435676:0:17203:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788748553.435680:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748553.435681:0:17203:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788748553.435684:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788748553.435687:0:17203:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:1.0:1788748553.435711:0:17203:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788748553.435713:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748553.435730:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8adc83b10000) 00000020:00000080:1.0:1788748553.435747:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788748553.435752:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788748553.435825:0:17203:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788748553.435831:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788748553.435849:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b0eb 00010000:00080000:1.0:1788748553.435877:0:17203:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8addae418000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748553.436122:0:17203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788748553.437252:0:17203:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788748553.438264:0:17203:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788748553.452001:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748553.452256:0:17203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788748553.458751:0:17203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788748553.465131:0:17209:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788748553.465138:0:17209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788748553.466461:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788748553.466474:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788748553.466513:0:17203:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788748553.466532:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e1b0f2 00000100:00080000:2.0:1788748553.466542:0:17203:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748553.466564:0:17203:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8addae418000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748553.466601:0:17203:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e4380 x1875638388686976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748553.466620:0:17203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788748553.466691:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748553.466695:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.466697:0:17203:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788748553.466700:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788748553.466702:0:17203:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788748553.466704:0:17203:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788748553.466706:0:17203:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788748553.466708:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788748553.466710:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.466711:0:17203:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788748553.466714:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788748553.466717:0:17203:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788748553.466720:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.466721:0:17203:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788748553.466724:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788748553.466727:0:17203:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:2.0:1788748553.466749:0:17203:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788748553.466752:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1788748553.466862:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388686976:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788748553.466918:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388686976 offset 0 length 520: 4 00000020:00000080:2.0:1788748553.467006:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8addb538cd40) 00000020:00000080:2.0:1788748553.467019:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788748553.467025:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788748553.467094:0:17203:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788748553.467100:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788748553.467106:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9ba0f20a02e1b100 00010000:00080000:2.0:1788748553.467132:0:17203:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8add83fbb000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788748553.467365:0:17203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788748553.467433:0:17203:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788748553.467456:0:17203:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788748553.468003:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875638388686848:12345-0@lo:38:llog_process_th.0 Request processed in 33935us (34053us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788748553.468016:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788748553.468727:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748553.468735:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788748553.468740:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388686848:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788748553.469556:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748553.469791:0:17203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788748553.469935:0:17203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788748553.470379:0:17211:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788748553.470385:0:17211:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788748553.470978:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788748553.470988:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788748553.471022:0:17203:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788748553.471041:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e1b107 00000100:00080000:2.0:1788748553.471050:0:17203:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748553.471060:0:17203:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8add83fbb000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748553.471104:0:17203:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e4e00 x1875638388687104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748553.471130:0:17203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788748553.471245:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748553.471250:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.471252:0:17203:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788748553.471255:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748553.471259:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.471260:0:17203:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788748553.471263:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788748553.471265:0:17203:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788748553.471268:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748553.471270:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.471272:0:17203:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788748553.471274:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748553.471276:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.471278:0:17203:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788748553.471282:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788748553.471311:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17203:1875638388687232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748553.471414:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748553.471447:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388687232 00000100:00100000:2.0:1788748553.471453:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388687232 00000100:00100000:2.0:1788748553.471493:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748553.471502:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17203:x1875638388687232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748553.471600:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17203:x1875638388687232:12345-0@lo:502:llog_process_th.0 Request processed in 98us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748553.471607:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748553.471670:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748553.471691:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17203:1875638388687232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788748553.471714:0:17203:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748553.471718:0:17203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748553.471720:0:17203:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788748553.471724:0:17203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1788748553.471945:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388687104:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788748553.471991:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388687104 offset 0 length 520: 4 00000020:01000000:0.0:1788748553.472455:0:17164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788748553.472478:0:17164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788748553.472497:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e1b07b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b082 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.472509:0:17164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76800/0x9ba0f20a02e1b07b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b082 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748553.472518:0:17164:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc848d0800 from 1 10000000:01000000:0.0:1788748553.472520:0:17164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748553.472549:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.472557:0:17164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.472567:0:17164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748553.472582:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748553.472612:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.472648:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118600 going to sleep for 11 seconds 00000100:00100000:2.0:1788748553.472739:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388687360 00000100:00100000:2.0:1788748553.472744:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388687360 00000100:00100000:2.0:1788748553.472815:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788748553.472823:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+9:17164:x1875638388687360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748553.472834:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748553.472849:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b10e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.472871:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 10 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.472882:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 10 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.472903:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bce00, rc 0) 00000100:00100000:2.0:1788748553.472947:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+10:17164:x1875638388687360:12345-0@lo:101:mount.lustre.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748553.472954:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748553.473019:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748553.473032:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.473049:0:17164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748553.473676:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687488:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788748553.473722:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.474519:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748553.474591:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388687488 00000100:00100000:3.0:1788748553.474599:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388687488 00000100:00100000:3.0:1788748553.474633:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748553.474640:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+10:17164:x1875638388687488:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788748553.474659:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788748553.474664:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788748553.474751:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+10:17164:x1875638388687488:12345-0@lo:256:mount.lustre.0 Request processed in 111us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.474864:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687488:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788748553.475451:0:17164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748553.475470:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.475481:0:17164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748553.475488:0:17164:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc848d0800 from 1 10000000:01000000:0.0:1788748553.475490:0:17164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748553.475519:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.475527:0:17164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.475537:0:17164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748553.475554:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748553.475589:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.475660:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748553.475836:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748553.475867:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388687616 00000100:00100000:3.0:1788748553.475872:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388687616 00000100:00100000:3.0:1788748553.475891:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748553.475898:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+10:17164:x1875638388687616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748553.475908:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748553.475924:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b11c expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.475943:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 11 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.475952:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 11 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.475961:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77400, rc 0) 00000100:00100000:3.0:1788748553.476004:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17164:x1875638388687616:12345-0@lo:101:mount.lustre.0 Request processed in 107us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.476011:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748553.476146:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748553.476170:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.476180:0:17164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748553.476235:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748553.476262:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.476294:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748553.476443:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388687744 00000100:00100000:3.0:1788748553.476448:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388687744 00000100:00100000:3.0:1788748553.476466:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788748553.476473:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17164:x1875638388687744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748553.476581:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17164:x1875638388687744:12345-0@lo:501:mount.lustre.0 Request processed in 108us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.476589:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748553.476650:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748553.476692:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748553.476728:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.476749:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748553.476850:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388687872 00000100:00100000:3.0:1788748553.476855:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388687872 00000100:00100000:3.0:1788748553.476873:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748553.476879:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17164:x1875638388687872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748553.476959:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17164:x1875638388687872:12345-0@lo:503:mount.lustre.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.476966:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748553.477110:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388687872:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748553.477561:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17213:1875638388688000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748553.477599:0:17213:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.477633:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8860f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748553.477675:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688000 00000100:00100000:2.0:1788748553.477679:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688000 00000100:00100000:2.0:1788748553.477781:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748553.477790:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17213:x1875638388688000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788748553.479790:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17213:x1875638388688000:12345-0@lo:502:llog_process_th.0 Request processed in 1994us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748553.479803:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748553.480249:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17213:1875638388688000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748553.480285:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748553.480297:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.480299:0:17213:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788748553.480307:0:17213:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc848d0800 00000020:00000080:0.0:1788748553.480310:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748553.480452:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748553.480457:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.480458:0:17213:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788748553.480461:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748553.480464:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.480473:0:17213:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788748553.480478:0:17213:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc848d0800 00000020:00000080:0.0:1788748553.480479:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748553.480568:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748553.480571:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.480573:0:17213:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788748553.480575:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748553.480578:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.480579:0:17213:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788748553.480582:0:17213:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc848d0800 00000020:00000080:0.0:1788748553.480584:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788748553.481398:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748553.481404:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.481406:0:17213:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788748553.481409:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748553.481412:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.481413:0:17213:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788748553.481417:0:17213:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc848d0800 00000020:00000080:0.0:1788748553.481419:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788748553.481474:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17213:1875638388688128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748553.481533:0:17213:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.481613:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748553.483863:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688128 00000100:00100000:3.0:1788748553.483875:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688128 00000100:00100000:3.0:1788748553.483927:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788748553.483936:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17213:x1875638388688128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748553.484096:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17213:x1875638388688128:12345-0@lo:502:llog_process_th.0 Request processed in 161us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.484105:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788748553.484891:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17213:1875638388688128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788748553.484923:0:17213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748553.484930:0:17213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748553.484933:0:17213:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788748553.484936:0:17213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788748553.485008:0:17164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788748553.485028:0:17164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748553.485045:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.485074:0:17164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748553.485126:0:17164:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788748553.485129:0:17164:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc848d0800 10000000:01000000:0.0:1788748553.485131:0:17164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc848d0800 10000000:01000000:0.0:1788748553.485136:0:17164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788748553.485141:0:17164:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc848d0800 from 1 10000000:01000000:0.0:1788748553.485144:0:17164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788748553.485182:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e1b12a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.485191:0:17164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e1b12a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.485199:0:17164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e1b12a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748553.485217:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388688256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748553.485261:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.485295:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748553.485312:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688256 00000100:00100000:0.0:1788748553.485337:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688256 00000100:00100000:0.0:1788748553.485367:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748553.485375:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17164:x1875638388688256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748553.485386:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748553.485398:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940400/0x9ba0f20a02e1b131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b12a expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.485429:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940400/0x9ba0f20a02e1b131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b12a expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.485438:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940400/0x9ba0f20a02e1b131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b12a expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.485446:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940400, rc 0) 00000100:00100000:0.0:1788748553.485478:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17164:x1875638388688256:12345-0@lo:101:mount.lustre.0 Request processed in 104us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.485485:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748553.485520:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388688256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748553.485533:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e1b12a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b131 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.485541:0:17164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e1b12a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b131 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748553.485586:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388688384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748553.485609:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.485622:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748553.485635:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688384 00000100:00100000:0.0:1788748553.485639:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688384 00000100:00100000:0.0:1788748553.485660:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748553.485666:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17164:x1875638388688384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748553.485904:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17164:x1875638388688384:12345-0@lo:501:mount.lustre.0 Request processed in 237us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.485920:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748553.485953:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388688384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748553.485979:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388688512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748553.486015:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.486028:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748553.486041:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688512 00000100:00100000:0.0:1788748553.486044:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688512 00000100:00100000:0.0:1788748553.486061:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748553.486079:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17164:x1875638388688512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748553.486149:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17164:x1875638388688512:12345-0@lo:503:mount.lustre.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.486269:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748553.486309:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388688512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748553.492432:0:17215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17215:1875638388688640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748553.492511:0:17215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748553.492567:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688640 00000100:00100000:3.0:1788748553.492574:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688640 00000100:00100000:3.0:1788748553.492614:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748553.492622:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17215:x1875638388688640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748553.492723:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17215:x1875638388688640:12345-0@lo:502:llog_process_th.0 Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.492730:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748553.492849:0:17215:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add87cab840 going to sleep for 11 seconds 00000100:00100000:3.0:1788748553.492871:0:17215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17215:1875638388688640:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788748553.492924:0:17215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788748553.492938:0:17215:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8addb3d64d40) 00000020:00000080:3.0:1788748553.492960:0:17215:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788748553.493038:0:17215:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc848d0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788748553.493043:0:17215:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc848d0800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788748553.493046:0:17215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc848d0800 4 00010000:00080000:3.0:1788748553.493092:0:17215:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adda719c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1788748553.497208:0:17215:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788748553.497437:0:17215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788748553.497481:0:17215:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788748553.497495:0:17215:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9ba0f20a02e1b13f 00000100:00080000:0.0:1788748553.497504:0:17215:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748553.497516:0:17215:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8adda719c800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748553.497551:0:17215:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8380d500 x1875638388688768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748553.497577:0:17215:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788748553.497860:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388688768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788748553.497920:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.508415:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688768 00000100:00100000:0.0:1788748553.508429:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688768 00000100:00100000:0.0:1788748553.508613:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748553.508629:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875638388688768:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788748553.508717:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875638388688768:12345-0@lo:38:llog_process_th.0 Request processed in 89us (10795us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788748553.508723:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748553.509458:0:17215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17215:1875638388688896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748553.509462:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748553.509470:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adda719c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748553.509474:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788748553.509478:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388688768:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788748553.509763:0:17215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.509792:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388688896 00000100:00100000:0.0:1788748553.509797:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388688896 00000100:00100000:0.0:1788748553.509839:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748553.509847:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17215:x1875638388688896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748553.509945:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17215:x1875638388688896:12345-0@lo:502:llog_process_th.0 Request processed in 98us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.510052:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748553.510111:0:17215:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118180 going to sleep for 11 seconds 00000100:00100000:0.0:1788748553.510125:0:17215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17215:1875638388688896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748553.511946:0:17215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17215:1875638388689024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788748553.512928:0:17215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.512991:0:17215:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118180 going to sleep for 11 seconds 00000100:00100000:3.0:1788748553.513962:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689024 00000100:00100000:3.0:1788748553.513974:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689024 00000100:00100000:3.0:1788748553.514027:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748553.514037:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17215:x1875638388689024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788748553.514212:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17215:x1875638388689024:12345-0@lo:502:llog_process_th.0 Request processed in 177us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.514221:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748553.519123:0:17215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f35c4edf-1df7-4d0c-8881-06ee23716a92:17215:1875638388689024:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788748553.519167:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788748553.519243:0:17164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788748553.519264:0:17164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788748553.520078:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e1b12a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b131 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.520093:0:17164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940a00/0x9ba0f20a02e1b12a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b131 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788748553.520155:0:17164:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788748553.520157:0:17164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788748553.520159:0:17164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748553.520160:0:17164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748553.520161:0:17164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748553.520162:0:17164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748553.520163:0:17164:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788748553.520165:0:17164:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788748553.520167:0:17164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748553.520169:0:17164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748553.520173:0:17164:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788748553.520175:0:17164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788748553.520177:0:17164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788748553.520178:0:17164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748553.520179:0:17164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748553.520180:0:17164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748553.520181:0:17164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748553.520182:0:17164:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788748553.520183:0:17164:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788748553.520184:0:17164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748553.520185:0:17164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788748553.520208:0:17164:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788748553.520228:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388689152:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788748553.523638:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.523701:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add82fc73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748553.523741:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689152 00000100:00100000:0.0:1788748553.523749:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689152 00000100:00100000:0.0:1788748553.529492:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748553.529513:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17164:x1875638388689152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788748553.529551:0:17177:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788748553.529566:0:17177:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788748553.533014:0:17177:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788748553.533034:0:17177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788748553.533730:0:17201:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788748553.533736:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788748553.533757:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.533777:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.533786:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.533824:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748553.533838:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 12 pid: 17180 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748553.533865:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388689280:0@lo:104: 00000100:00100000:2.0:1788748553.533925:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.534101:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689280 00000100:00100000:0.0:1788748553.534108:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689280 00000100:00100000:0.0:1788748553.534151:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748553.534160:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388689280:12345-0@lo:104: 00010000:00010000:0.0:1788748553.534171:0:17168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748553.534226:0:17168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748553.534231:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388689280:12345-0@lo:104: Request processed in 74us (308us total) trans 0 rc 0/0 00010000:00010000:1.0:1788748553.534233:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788748553.534238:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788748553.534240:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.534247:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940000 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748553.534250:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.534259:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748553.534267:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748553.534272:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788748553.534298:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3bace40 going to sleep for 11 seconds 00010000:00010000:1.0:1788748553.534306:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.534312:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748553.534348:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.534368:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b10e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b115 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748553.534385:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748553.534387:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748553.534388:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748553.534410:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748553.534421:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388689408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748553.534686:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388689280:0@lo:104: 00010000:00010000:2.0:1788748553.534705:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748553.536231:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748553.539611:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17164:x1875638388689152:12345-0@lo:253:mount.lustre.0 Request processed in 10098us (15970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748553.539626:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788748553.539718:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17164:1875638388689152:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748553.539734:0:17164:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788748553.539738:0:17164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748553.539739:0:17164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788748553.539741:0:17164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748553.539742:0:17164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748553.539743:0:17164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748553.539744:0:17164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748553.539745:0:17164:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788748553.539747:0:17164:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788748553.539749:0:17164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748553.539751:0:17164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788748553.539765:0:17164:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788748553.543740:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689408 00000100:00100000:3.0:1788748553.543755:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689408 00010000:00010000:3.0:1788748553.543795:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 12 pid: 17180 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748553.543829:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748553.543837:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:3635:x1875638388689408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748553.543852:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748553.543857:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 12 pid: 17180 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543868:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 12 pid: 17180 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543884:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b10e expref: 12 pid: 17180 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543897:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543906:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788748553.543922:0:17170:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010187036s 00010000:00010000:3.0:1788748553.543926:0:17170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543942:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543949:0:17170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543955:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543962:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748553.543967:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543974:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.543990:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.544001:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748553.544076:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:3635:x1875638388689408:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (7849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748553.544083:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788748553.544110:0:17201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.544117:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748553.544123:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bd400/0x9ba0f20a02e1b146 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748553.544485:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388689408:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788748553.581090:0:17164:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788748553.581578:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788748553.581648:0:17225:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788748553.581652:0:17225:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788748553.581918:0:17226:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788748553.582032:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788748553.582450:0:17227:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8adc825c0000 x1875638388689536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748553.582462:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00000040:01000000:1.0:1788748553.582826:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788748553.582855:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748553.583635:0:17226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788748553.584917:0:17164:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788748553.584930:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788748553.585202:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748553.586397:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788748553.586473:0:17226:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788748553.587269:0:17164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788748553.588558:0:17164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788748553.588610:0:17164:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788748553.590218:0:17164:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788748553.593084:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788748553.595072:0:17164:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788748553.595104:0:17164:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf7080d1f988 00100000:10000000:3.0:1788748553.595111:0:17164:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788748553.595897:0:17164:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788748553.595912:0:17164:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788748553.595929:0:17164:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788748553.595949:0:17164:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788748553.612099:0:17164:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748553.612570:0:17164:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748554.152726:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748554.533814:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748554.600821:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 10000000:01000000:2.0:1788748554.663748:0:17182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788748554.663755:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc848d0800 from 7 10000000:01000000:2.0:1788748554.663761:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748554.663808:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748554.663819:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748554.663831:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748554.663858:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388689664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748554.663950:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748554.664004:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748554.666085:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689664 00000100:00100000:2.0:1788748554.666100:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689664 00000100:00100000:2.0:1788748554.666170:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748554.666194:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+11:17182:x1875638388689664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748554.666213:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748554.666234:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b14d expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748554.666260:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748554.666270:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748554.666278:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd600, rc 0) 00000100:00100000:2.0:1788748554.666372:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17182:x1875638388689664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748554.666378:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748554.666431:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388689664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748554.666449:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748554.666459:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748554.666524:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388689792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788748554.666561:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748554.666592:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748554.666657:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689792 00000100:00100000:0.0:1788748554.666662:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689792 00000100:00100000:0.0:1788748554.666705:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788748554.666713:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17182:x1875638388689792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788748554.666727:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788748554.666744:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788748554.666748:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788748554.666829:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17182:x1875638388689792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748554.666837:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788748554.666875:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388689792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788748554.666914:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748554.666932:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748554.666942:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748555.173197:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788748555.556912:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788748555.626218:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:0.0:1788748556.196580:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748556.645881:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:2.0:1788748557.220783:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748557.668538:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:0.0:1788748558.245875:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788748558.631272:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788748558.631279:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788748558.631283:0:8:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748558.631291:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:0.0:1788748558.631297:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788748558.631308:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8addb3926000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748558.631361:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8380e680 x1875638388690048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748558.631380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748558.631384:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788748558.631387:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788748558.631390:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788748558.631395:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388689920:0@lo:400:kworker.0 00000100:00080000:0.0:1788748558.631395:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788748558.631402:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788748558.631406:0:8:0:(import.c:65:import_set_state_nolock()) ffff8adda719c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788748558.631412:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8adda719c800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748558.631425:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8380c700 x1875638388690176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748558.631464:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748558.631535:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690048:0@lo:38:kworker.0 00000100:00100000:3.0:1788748558.631563:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748558.631585:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388690176:0@lo:38:kworker.0 00000100:00100000:3.0:1788748558.631607:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748558.631664:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388690048 00000100:00100000:3.0:1788748558.631671:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388690048 00000100:00100000:3.0:1788748558.631700:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748558.631707:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875638388690048:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788748558.631723:0:17191:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788748558.633111:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689920 00000100:00100000:0.0:1788748558.633120:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689920 00000100:00100000:0.0:1788748558.633171:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748558.633180:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:3637:x1875638388689920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748558.633271:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:3637:x1875638388689920:12345-0@lo:400:kworker.0 Request processed in 93us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748558.633278:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748558.637155:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388690176 00000100:00100000:0.0:1788748558.637169:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388690176 00000100:00100000:0.0:1788748558.637211:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788748558.637220:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875638388690176:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788748558.637247:0:17186:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1788748558.637298:0:17186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9ba0f20a02e1b15b 00000004:00100000:0.0:1788748558.637312:0:17186:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788748558.637467:0:17186:0:(import.c:65:import_set_state_nolock()) ffff8add913f0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748558.637552:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875638388690176:12345-0@lo:38:kworker.0 Request processed in 333us (5944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748558.637559:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788748558.637889:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc8380c700 x1875638388690176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788748558.637920:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788748558.637928:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788748558.637934:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788748558.637936:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adda719c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788748558.637943:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875638388690176:0@lo:38:kworker.0 00000100:00100000:2.0:1788748558.650994:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388689920:0@lo:400:kworker.0 00000001:02000400:0.0:1788748558.653913:0:17470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788748558.660747:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875638388690048:12345-0@lo:38:kworker.0 Request processed in 29034us (29177us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788748558.660766:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788748558.662473:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748558.662483:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788748558.662502:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690048:0@lo:38:kworker.0 00000100:00100000:3.0:1788748558.692668:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:2.0:1788748559.272456:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788748559.522709:0:17522:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748559.522895:0:17522:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788748559.716526:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:1.0:1788748560.294999:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788748560.368698:0:17572:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748560.368937:0:17572:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788748560.741525:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:2.0:1788748561.322632:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748561.764733:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:2.0:1788748562.341734:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748562.788455:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:1.0:1788748563.365720:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748563.748485:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788748563.748492:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788748563.748495:0:8:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748563.748503:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:3.0:1788748563.748509:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788748563.748520:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8addb3926000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748563.748541:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc825c3480 x1875638388690432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748563.748553:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748563.748557:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788748563.748560:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748563.748565:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748563.748565:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388690304:0@lo:400:kworker.0 00000100:00100000:2.0:1788748563.748632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748563.748713:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748563.748723:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388690560:0@lo:400:kworker.0 00000100:00100000:0.0:1788748563.748742:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388690304 00000100:00100000:0.0:1788748563.748751:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388690304 00000100:00100000:2.0:1788748563.748758:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748563.748797:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788748563.748807:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:3638:x1875638388690304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748563.748868:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:3638:x1875638388690304:12345-0@lo:400:kworker.0 Request processed in 64us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748563.748875:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788748563.748955:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388690560 00000100:00100000:3.0:1788748563.748960:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388690560 00000100:00100000:3.0:1788748563.749004:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748563.749012:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388690560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748563.749058:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748553/real 1788748553] req@ffff8adc843e4e00 x1875638388687104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748563 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748563.749072:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388690560:12345-0@lo:400:kworker.0 Request processed in 59us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748563.749079:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e4e00 x1875638388687104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748563 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748563.749080:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788748563.749142:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748553/real 1788748553] req@ffff8adc843e4380 x1875638388686976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748563 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748563.749154:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e4380 x1875638388686976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748563 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748563.749167:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690432:0@lo:38:kworker.0 00000100:00100000:1.0:1788748563.749213:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748563.749243:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add83fbb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748563.749252:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788748563.749255:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388687104:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788748563.749261:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addae418000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748563.749279:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788748563.749283:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388686976:0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788748563.749362:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc825c2300 x1875638388690560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748563.749380:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388690560:0@lo:400:kworker.0 00000100:00100000:2.0:1788748563.749411:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388690304:0@lo:400:kworker.0 00000100:00100000:3.0:1788748563.749425:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388690432 00000100:00100000:3.0:1788748563.749431:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388690432 00000100:00100000:3.0:1788748563.749465:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748563.749471:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875638388690432:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788748563.749495:0:17190:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788748563.751460:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748563.751469:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788748563.751473:0:8:0:(import.c:65:import_set_state_nolock()) ffff8addae418000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748563.751480:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:2.0:1788748563.751485:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788748563.751511:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8addae418000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748563.751544:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e4000 x1875638388690688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748563.751566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748563.751569:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788748563.751571:0:8:0:(import.c:65:import_set_state_nolock()) ffff8add83fbb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748563.751574:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:2.0:1788748563.751577:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788748563.751581:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8add83fbb000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748563.751592:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e4700 x1875638388690816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748563.751919:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690688:0@lo:8:kworker.0 00000400:00000100:1.0:1788748563.751978:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388690688 offset 0 length 520: 4 00000100:00100000:1.0:1788748563.752027:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690816:0@lo:8:kworker.0 00000400:00000100:1.0:1788748563.752048:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388690816 offset 0 length 520: 4 00000100:00100000:3.0:1788748563.763256:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875638388690432:12345-0@lo:38:kworker.0 Request processed in 13774us (14032us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788748563.763269:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788748563.763569:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748563.763576:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788748563.763580:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690432:0@lo:38:kworker.0 00000100:00100000:3.0:1788748563.814286:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:2.0:1788748564.393038:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748564.840426:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:1.0:1788748565.413679:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788748565.799214:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748565.861754:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:2.0:1788748566.443767:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748566.885109:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00000020:01000004:0.0:1788748567.099448:0:17917:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788748567.099452:0:17917:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788748567.099454:0:17917:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788748567.099572:0:17917:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8add913f3000 00000020:01000004:0.0:1788748567.099586:0:17917:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788748567.099598:0:17917:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788748567.099611:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8addb39399c0) 00000020:00000080:0.0:1788748567.099627:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788748567.143527:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788748567.144173:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788748567.145132:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788748567.145345:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788748567.145716:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788748567.145876:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788748567.146052:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788748567.146217:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788748567.146458:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788748567.146714:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788748567.146873:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788748567.150212:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788748567.150690:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788748567.150925:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788748567.152823:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.153001:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.153166:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.153407:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.153646:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.153886:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.154083:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.154274:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.154484:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.154680:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.154873:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.155364:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.155554:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.155724:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.155880:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.156044:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.156200:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.160090:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.160500:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.160724:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.160961:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.161179:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.161415:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.161618:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.161869:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.162100:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.162303:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.162549:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.162735:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.162900:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788748567.163081:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788748567.163248:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00080000:01000000:3.0:1788748567.163920:0:17917:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788748567.164122:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788748567.164132:0:17917:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788748567.164141:0:17917:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e1b169 00000020:01000004:3.0:1788748567.164147:0:17917:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788748567.164165:0:17917:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788748567.164168:0:17917:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788748567.164173:0:17917:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788748567.164208:0:17917:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788748567.164212:0:17917:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788748567.167359:0:17917:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788748567.167392:0:17917:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788748567.167397:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788748567.167399:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748567.167403:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748567.167404:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748567.167406:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748567.167407:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748567.167408:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748567.167410:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748567.167411:0:17917:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748567.167414:0:17917:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788748567.167416:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748567.167417:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748567.167419:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748567.167420:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748567.167421:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748567.167422:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748567.167423:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748567.167424:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748567.167425:0:17917:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788748567.167448:0:17917:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788748567.167465:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388690944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788748567.167526:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.167622:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.167692:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388690944 00000100:00100000:0.0:1788748567.167699:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388690944 00000100:00100000:0.0:1788748567.167743:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788748567.167751:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17917:x1875638388690944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788748567.167785:0:17177:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788748567.167788:0:17177:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788748567.167795:0:17177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788748567.168284:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17917:x1875638388690944:12345-0@lo:253:mount.lustre.0 Request processed in 530us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.168293:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748567.168443:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388690944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788748567.168454:0:17917:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788748567.168457:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748567.168458:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748567.168458:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748567.168459:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748567.168460:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748567.168461:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748567.168462:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748567.168463:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748567.168464:0:17917:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788748567.168481:0:17917:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8add913f3000 from lustre-MDT0001 10000000:01000000:3.0:1788748567.168508:0:17917:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788748567.168512:0:17917:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788748567.168518:0:17917:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adc840f99c0 local copy 00010000:00010000:3.0:1788748567.168526:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748567.168620:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748567.168648:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.168756:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.168786:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691072 00000100:00100000:0.0:1788748567.168790:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691072 00000100:00100000:0.0:1788748567.168854:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788748567.168862:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17917:x1875638388691072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748567.168923:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17917:x1875638388691072:12345-0@lo:501:mount.lustre.0 Request processed in 62us (274us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748567.168930:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748567.168987:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691072:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788748567.168998:0:17917:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788748567.169012:0:17917:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788748567.169018:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169026:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748567.169046:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8add913f3000 10000000:01000000:3.0:1788748567.169049:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788748567.169053:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8adc840f99c0 10000000:01000000:3.0:1788748567.169055:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788748567.169058:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8adc840f99c0 from 1 10000000:01000000:3.0:1788748567.169061:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788748567.169079:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1b170 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169087:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1b170 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169096:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1b170 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748567.169116:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748567.169138:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.169195:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.169247:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691200 00000100:00100000:2.0:1788748567.169251:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691200 00000100:00100000:2.0:1788748567.169275:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748567.169280:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+12:17917:x1875638388691200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748567.169289:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748567.169301:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bd800/0x9ba0f20a02e1b177 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b170 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.169350:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bd800/0x9ba0f20a02e1b177 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b170 expref: 13 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.169360:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bd800/0x9ba0f20a02e1b177 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b170 expref: 13 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.169368:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd800, rc 0) 00000100:00100000:2.0:1788748567.169402:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+13:17917:x1875638388691200:12345-0@lo:101:mount.lustre.0 Request processed in 121us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.169407:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748567.169503:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748567.169516:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1b170 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b177 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169525:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1b170 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b177 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748567.169539:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788748567.169548:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1b170 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b177 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169554:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76400/0x9ba0f20a02e1b170 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b177 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748567.169561:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8add913f3000 10000000:01000000:3.0:1788748567.169564:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788748567.169567:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8add913f3000 from 1 10000000:01000000:3.0:1788748567.169569:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788748567.169583:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e1b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169589:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e1b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169595:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e1b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748567.169613:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748567.169637:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.169657:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.169773:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691328 00000100:00100000:2.0:1788748567.169778:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691328 00000100:00100000:2.0:1788748567.169797:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748567.169803:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+13:17917:x1875638388691328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748567.169810:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748567.169819:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bda00/0x9ba0f20a02e1b185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b17e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.169832:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bda00/0x9ba0f20a02e1b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b17e expref: 14 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.169839:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bda00/0x9ba0f20a02e1b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b17e expref: 14 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.169855:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bda00, rc 0) 00000100:00100000:2.0:1788748567.169890:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+14:17917:x1875638388691328:12345-0@lo:101:mount.lustre.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.169895:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788748567.169955:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748567.169965:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e1b17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b185 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.169984:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e1b17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b185 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748567.169994:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788748567.170006:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e1b17e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b185 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.170013:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77200/0x9ba0f20a02e1b17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b185 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748567.170018:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788748567.170022:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748567.170025:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8add913f3000 10000000:01000000:3.0:1788748567.170027:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788748567.170030:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788748567.170032:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788748567.170043:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e1b18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.170050:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e1b18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.170063:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e1b18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748567.170075:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748567.170098:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.170108:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.170154:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691456 00000100:00100000:2.0:1788748567.170157:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691456 00000100:00100000:2.0:1788748567.170172:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788748567.170177:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+14:17917:x1875638388691456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748567.170182:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748567.170189:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bca00/0x9ba0f20a02e1b193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b18c expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.170199:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bca00/0x9ba0f20a02e1b193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b18c expref: 15 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.170206:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bca00/0x9ba0f20a02e1b193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b18c expref: 15 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.170212:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bca00, rc 0) 00000100:00100000:2.0:1788748567.170244:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691456:12345-0@lo:101:mount.lustre.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.170249:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788748567.170306:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748567.170342:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e1b18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b193 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.170351:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e1b18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b193 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748567.171360:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788748567.171855:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748567.175481:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788748567.175540:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788748567.175556:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788748567.175570:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788748567.175582:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788748567.175594:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788748567.175606:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788748567.175618:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788748567.175630:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788748567.175643:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788748567.175655:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788748567.175739:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788748567.175759:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788748567.175774:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788748567.175798:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788748567.175811:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788748567.175824:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788748567.175837:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788748567.175850:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788748567.175863:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788748567.175876:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788748567.175888:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788748567.175899:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788748567.175925:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788748567.175931:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788748567.176054:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748567.176119:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.176223:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.176271:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691584 00000100:00100000:2.0:1788748567.176279:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691584 00000100:00100000:2.0:1788748567.176673:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788748567.176686:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748567.176879:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691584:12345-0@lo:501:mount.lustre.0 Request processed in 195us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.176897:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788748567.177054:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748567.177092:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748567.177135:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.177169:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748567.177223:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691712 00000100:00100000:1.0:1788748567.177229:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691712 00000100:00100000:1.0:1788748567.177265:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748567.177273:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748567.177954:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691712:12345-0@lo:503:mount.lustre.0 Request processed in 680us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748567.177963:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788748567.178103:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691712:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788748567.178493:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748567.178560:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748567.178602:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.178628:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748567.178748:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691840 00000100:00100000:1.0:1788748567.178754:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691840 00000100:00100000:1.0:1788748567.178780:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788748567.178787:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748567.179270:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691840:12345-0@lo:502:mount.lustre.0 Request processed in 482us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748567.179279:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788748567.179424:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748567.179603:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788748567.179632:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788748567.179956:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788748567.179999:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788748567.180015:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788748567.180028:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788748567.180042:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788748567.180056:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788748567.180069:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788748567.180082:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788748567.180094:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788748567.180108:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788748567.180123:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788748567.180137:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788748567.180150:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788748567.180163:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788748567.180176:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788748567.180188:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788748567.180200:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788748567.180212:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788748567.180224:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788748567.180238:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788748567.180254:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788748567.180268:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788748567.180282:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788748567.180296:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788748567.180309:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788748567.180485:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788748567.180503:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788748567.180516:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788748567.180529:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788748567.180541:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788748567.180553:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788748567.180565:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788748567.180576:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788748567.180589:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788748567.180611:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788748567.180621:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788748567.180632:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788748567.180643:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788748567.180654:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788748567.180730:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788748567.180749:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788748567.180760:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788748567.180795:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748567.180849:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.180926:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748567.180962:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388691968 00000100:00100000:1.0:1788748567.180969:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388691968 00000100:00100000:1.0:1788748567.181055:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748567.181063:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748567.181164:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388691968:12345-0@lo:502:mount.lustre.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748567.181172:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748567.181242:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388691968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748567.181280:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788748567.181287:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788748567.182151:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748567.182162:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748567.182165:0:17921:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788748567.182171:0:17921:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788748567.182173:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748567.182188:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8addb3d60000) 00000020:00000080:3.0:1788748567.182208:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788748567.182214:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788748567.182292:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788748567.182300:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e1b1a1 00000020:00000080:3.0:1788748567.182521:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788748567.182526:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748567.182529:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748567.182531:0:17921:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788748567.182534:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748567.182538:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748567.182539:0:17921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788748567.182551:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748567.182568:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8addb5b199c0) 00000020:00000080:3.0:1788748567.182580:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788748567.182586:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788748567.182588:0:17921:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788748567.182591:0:17921:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788748567.182598:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788748567.182645:0:17921:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8add913f3000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788748567.182657:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8addb5b1b380) 00000020:00000080:3.0:1788748567.182745:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788748567.182820:0:17921:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788748567.182827:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e1b1b6 00000020:00000080:3.0:1788748567.182925:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788748567.182932:0:17921:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788748567.182936:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9ba0f20a02e1b1bd 00080000:01000000:3.0:1788748567.182941:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788748567.182945:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e1b1c4 00010000:00010000:2.0:1788748567.262579:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788748567.264124:0:17921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788748567.264491:0:17921:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788748567.266885:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788748567.266899:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748567.266906:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748567.266908:0:17921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788748567.266912:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748567.266918:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748567.266920:0:17921:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788748567.266923:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788748567.266928:0:17921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:3.0:1788748567.266955:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748567.266981:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8addb5b18000) 00000020:00000080:3.0:1788748567.267004:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788748567.267009:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788748567.267077:0:17921:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788748567.267083:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788748567.267090:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e1b1d2 00010000:00080000:3.0:1788748567.267131:0:17921:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc82c25000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788748567.270101:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788748567.278199:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788748567.278213:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788748567.278251:0:17921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788748567.278271:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e1b1d9 00000100:00080000:1.0:1788748567.278280:0:17921:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748567.278290:0:17921:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8adc82c25000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748567.278351:0:17921:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842f9500 x1875638388692096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748567.278375:0:17921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788748567.278430:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748567.278434:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.278436:0:17921:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788748567.278439:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788748567.278441:0:17921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788748567.278443:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748567.278444:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748567.278446:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788748567.278448:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.278450:0:17921:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788748567.278452:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748567.278457:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.278458:0:17921:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788748567.278462:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788748567.278505:0:17921:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788748567.278519:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748567.278523:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.278525:0:17921:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788748567.278527:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788748567.278529:0:17921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788748567.278530:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748567.278531:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748567.278533:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788748567.278535:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.278537:0:17921:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788748567.278539:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748567.278542:0:17921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788748567.278546:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.278547:0:17921:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788748567.278551:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788748567.278554:0:17921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:1.0:1788748567.278577:0:17921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788748567.278579:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748567.278593:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8adc83b14d40) 00000020:00000080:1.0:1788748567.278604:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788748567.278610:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788748567.278739:0:17921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788748567.278746:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788748567.278753:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e1b1e7 00010000:00080000:1.0:1788748567.278781:0:17921:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8add84d0a800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748567.279001:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788748567.279379:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388692096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788748567.279447:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748567.279521:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388692096 00000100:00100000:2.0:1788748567.279528:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388692096 00000100:00100000:2.0:1788748567.279561:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748567.279568:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875638388692096:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788748567.279592:0:17191:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1788748567.279626:0:17191:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e1b1ee 00000004:00100000:2.0:1788748567.279640:0:17191:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788748567.279645:0:17191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788748567.279814:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788748567.279819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788748567.279822:0:8:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788748567.279827:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:3.0:1788748567.279832:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788748567.279839:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8addb3926000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788748567.279864:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc825c0700 x1875638388692224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788748567.279890:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748567.279894:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788748567.279896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748567.279899:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788748567.280389:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748567.280402:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388692352:0@lo:400:kworker.0 00000100:00100000:3.0:1788748567.280444:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788748567.280600:0:17921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788748567.280822:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388692224:0@lo:38:kworker.0 00000100:00100000:2.0:1788748567.280870:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.280944:0:17190:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788748567.280953:0:17190:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:1.0:1788748567.281024:0:17921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788748567.281441:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388692224 00000100:00100000:2.0:1788748567.281448:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388692224 00000100:00100000:3.0:1788748567.281580:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748567.281587:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875638388692224:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788748567.281661:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875638388692224:12345-0@lo:38:kworker.0 Request processed in 72us (789us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788748567.281678:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748567.282058:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748567.282067:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748567.282072:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788748567.282075:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388692224:0@lo:38:kworker.0 00000100:00100000:2.0:1788748567.283419:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388692352 00000100:00100000:2.0:1788748567.283428:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388692352 00000100:00100000:2.0:1788748567.283474:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748567.283493:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388692352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748567.283575:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388692352:12345-0@lo:400:kworker.0 Request processed in 84us (3130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.283581:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748567.283619:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc825c3100 x1875638388692352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748567.283632:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388692352:0@lo:400:kworker.0 00000100:00080000:2.0:1788748567.284045:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8add8f103800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748567.284097:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1875638388692096:12345-0@lo:38:llog_process_th.0 Request processed in 4528us (4650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.284104:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748567.284168:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748567.284185:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788748567.284193:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788748567.284199:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788748567.284201:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc82c25000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788748567.284220:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388692096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788748567.284599:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748567.284612:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388692480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748567.284649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748567.284788:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388692480 00000100:00100000:2.0:1788748567.284793:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388692480 00000040:00080000:1.0:1788748567.285027:0:17921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748567.285143:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748567.285153:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875638388692480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748567.285191:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788748567.285234:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875638388692480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.285240:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1788748567.285623:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788748567.285795:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788748567.286181:0:17927:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788748567.286186:0:17927:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788748567.286792:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788748567.286803:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788748567.286841:0:17921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788748567.286860:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e1b1f5 00000100:00080000:1.0:1788748567.286868:0:17921:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748567.286879:0:17921:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8add84d0a800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748567.286909:0:17921:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842fa300 x1875638388692608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748567.286947:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388692608:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788748567.287003:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388692608 offset 0 length 520: 4 00000100:00080000:1.0:1788748567.287051:0:17921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788748567.287176:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748567.287181:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788748567.287184:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748567.287186:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788748567.287233:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748567.287237:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.287239:0:17921:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788748567.287243:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788748567.287246:0:17921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788748567.287247:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748567.287248:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788748567.287250:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788748567.287252:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.287254:0:17921:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788748567.287256:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748567.287269:0:17921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788748567.287273:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.287275:0:17921:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788748567.287279:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788748567.287283:0:17921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:1.0:1788748567.287303:0:17921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788748567.287306:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748567.287338:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8adc83b119c0) 00000020:00000080:1.0:1788748567.287353:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788748567.287358:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788748567.287433:0:17921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788748567.287440:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788748567.287446:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9ba0f20a02e1b203 00010000:00080000:1.0:1788748567.287489:0:17921:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8add842b8800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748567.287703:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788748567.287761:0:17921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788748567.287775:0:17921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788748567.288595:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388692480:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788748567.289226:0:17921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748567.289494:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788748567.289598:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788748567.290033:0:17929:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788748567.290038:0:17929:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788748567.290965:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788748567.290988:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788748567.291024:0:17921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788748567.291043:0:17921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e1b20a 00000100:00080000:1.0:1788748567.291051:0:17921:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748567.291062:0:17921:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8add842b8800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748567.291093:0:17921:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842fb100 x1875638388692736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748567.291150:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388692736:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788748567.291194:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388692736 offset 0 length 520: 4 00000100:00080000:1.0:1788748567.291245:0:17921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788748567.291296:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748567.291306:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.291308:0:17921:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788748567.291311:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748567.291338:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.291340:0:17921:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788748567.291343:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788748567.291345:0:17921:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788748567.291347:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748567.291350:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.291351:0:17921:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788748567.291353:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748567.291355:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.291357:0:17921:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788748567.291360:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788748567.291384:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748567.291387:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748567.291388:0:17921:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788748567.291391:0:17921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:2.0:1788748567.291561:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748567.291567:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748567.291570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748567.291578:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788748567.291629:0:17917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788748567.291657:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788748567.291682:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e1b18c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b193 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.291693:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76c00/0x9ba0f20a02e1b18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b193 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748567.291702:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add913f3000 from 1 10000000:01000000:0.0:1788748567.291705:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748567.291730:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.291738:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.291760:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748567.291775:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388692864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788748567.291811:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748567.291833:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71aec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.291890:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388692864 00000100:00100000:2.0:1788748567.291896:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388692864 00000100:00100000:2.0:1788748567.291938:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748567.291947:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+15:17917:x1875638388692864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748567.291960:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748567.291981:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b211 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.292002:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.292013:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 16 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.292021:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc000, rc 0) 00000100:00100000:2.0:1788748567.292069:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+16:17917:x1875638388692864:12345-0@lo:101:mount.lustre.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.292075:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748567.292341:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388692864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748567.292355:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.292364:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748567.292929:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388692992:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788748567.292982:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748567.293006:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda73db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.293249:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388692992 00000100:00100000:0.0:1788748567.293254:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388692992 00000100:00100000:0.0:1788748567.293287:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788748567.293294:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+16:17917:x1875638388692992:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788748567.293310:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788748567.293359:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788748567.293363:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788748567.293447:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+16:17917:x1875638388692992:12345-0@lo:256:mount.lustre.0 Request processed in 154us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.293455:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788748567.293633:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388692992:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788748567.294385:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788748567.294402:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.294420:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748567.294428:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add913f3000 from 1 10000000:01000000:1.0:1788748567.294431:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748567.294458:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.294466:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.294474:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748567.294491:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788748567.294530:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748567.294609:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda73db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.294848:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388693120 00000100:00100000:0.0:1788748567.294854:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388693120 00000100:00100000:0.0:1788748567.294923:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788748567.294932:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+16:17917:x1875638388693120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748567.294944:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748567.294956:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b21f expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.294989:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.295012:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.295021:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941400, rc 0) 00000100:00100000:0.0:1788748567.295131:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693120:12345-0@lo:101:mount.lustre.0 Request processed in 201us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.295138:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748567.295202:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748567.295216:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.295224:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748567.295380:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748567.295415:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748567.295444:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748567.295841:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda73db000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.295905:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388693248 00000100:00100000:2.0:1788748567.295910:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388693248 00000100:00100000:2.0:1788748567.295937:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748567.295945:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748567.296057:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693248:12345-0@lo:501:mount.lustre.0 Request processed in 112us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.296064:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788748567.296145:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748567.296177:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748567.296217:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748567.296240:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda73db000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.296285:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388693376 00000100:00100000:2.0:1788748567.296294:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388693376 00000100:00100000:2.0:1788748567.296312:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748567.296347:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748567.296423:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693376:12345-0@lo:503:mount.lustre.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.296429:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788748567.296524:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788748567.296935:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748567.297020:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748567.297072:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748567.297151:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda73db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.299297:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388693504 00000100:00100000:0.0:1788748567.299310:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388693504 00000100:00100000:0.0:1788748567.299592:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788748567.299604:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748567.299836:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693504:12345-0@lo:502:mount.lustre.0 Request processed in 234us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.299844:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748567.299947:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748567.300189:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788748567.300224:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788748567.300239:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788748567.300255:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788748567.300268:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788748567.300281:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788748567.300292:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788748567.300304:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788748567.300342:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788748567.300376:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788748567.300393:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788748567.300426:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748567.300470:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748567.300506:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388693632 00000100:00100000:3.0:1788748567.300512:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.300512:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388693632 00000100:00100000:2.0:1788748567.300537:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788748567.300542:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748567.300619:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693632:12345-0@lo:502:mount.lustre.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.300624:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788748567.300687:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748567.300731:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788748567.300739:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788748567.301094:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748567.301103:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301106:0:17931:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788748567.301115:0:17931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8add913f3000 00000020:00000080:2.0:1788748567.301117:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788748567.301126:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748567.301129:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301130:0:17931:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788748567.301134:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748567.301136:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301137:0:17931:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788748567.301142:0:17931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8add913f3000 00000020:00000080:2.0:1788748567.301144:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788748567.301211:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748567.301215:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301217:0:17931:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788748567.301220:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748567.301241:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301242:0:17931:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788748567.301247:0:17931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8add913f3000 00000020:00000080:2.0:1788748567.301249:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788748567.301271:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748567.301274:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301275:0:17931:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788748567.301278:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788748567.301280:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301281:0:17931:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788748567.301284:0:17931:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8add913f3000 00000020:00000080:2.0:1788748567.301286:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788748567.301307:0:17931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788748567.301311:0:17931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788748567.301312:0:17931:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788748567.301332:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788748567.303785:0:17917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788748567.303826:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748567.303850:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.303862:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748567.303915:0:17917:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788748567.303918:0:17917:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8add913f3000 10000000:01000000:3.0:1788748567.303921:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8add913f3000 10000000:01000000:3.0:1788748567.303924:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748567.303929:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8add913f3000 from 1 10000000:01000000:3.0:1788748567.303931:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748567.303961:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76600/0x9ba0f20a02e1b22d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.303968:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76600/0x9ba0f20a02e1b22d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.304131:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76600/0x9ba0f20a02e1b22d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748567.304152:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748567.304209:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.304248:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748567.306466:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388693760 00000100:00100000:1.0:1788748567.306479:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388693760 00000100:00100000:1.0:1788748567.306528:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788748567.306537:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17917:x1875638388693760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748567.306554:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748567.306571:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a69600/0x9ba0f20a02e1b234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b22d expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.306598:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a69600/0x9ba0f20a02e1b234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b22d expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.306609:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a69600/0x9ba0f20a02e1b234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b22d expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.306619:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69600, rc 0) 00000100:00100000:1.0:1788748567.306944:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388693760:12345-0@lo:101:mount.lustre.0 Request processed in 407us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748567.306961:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788748567.314849:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748567.314877:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76600/0x9ba0f20a02e1b22d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b234 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.314890:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76600/0x9ba0f20a02e1b22d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b234 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748567.315943:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788748567.316193:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748567.316398:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788748567.316437:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788748567.316453:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788748567.316466:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788748567.316479:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788748567.316492:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788748567.316504:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788748567.316530:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788748567.316543:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788748567.316557:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788748567.316570:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788748567.316582:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788748567.316593:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788748567.316605:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788748567.316618:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788748567.316631:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788748567.316645:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788748567.320086:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788748567.320131:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788748567.320147:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788748567.320160:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788748567.320172:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788748567.320186:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788748567.320200:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788748567.320213:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788748567.320226:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788748567.320239:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788748567.320252:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788748567.320276:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788748567.320282:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788748567.320407:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748567.320470:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748567.320506:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83cc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.320589:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388693888 00000100:00100000:0.0:1788748567.320596:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388693888 00000100:00100000:0.0:1788748567.320643:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788748567.320652:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388693888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748567.321496:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388693888:12345-0@lo:501:mount.lustre.0 Request processed in 843us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.321505:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788748567.321633:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388693888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748567.321743:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748567.321789:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748567.321859:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83cc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.330422:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694016 00000100:00100000:0.0:1788748567.330437:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694016 00000100:00100000:0.0:1788748567.331008:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788748567.331019:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748567.331199:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694016:12345-0@lo:503:mount.lustre.0 Request processed in 182us (9409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.331213:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788748567.331337:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788748567.331784:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748567.331876:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748567.331926:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.335365:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.338109:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694144 00000100:00100000:2.0:1788748567.338121:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694144 00000100:00100000:2.0:1788748567.338176:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788748567.338187:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748567.338410:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694144:12345-0@lo:502:mount.lustre.0 Request processed in 224us (6482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.338418:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788748567.339157:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748567.339394:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788748567.339424:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788748567.339438:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788748567.339451:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788748567.339465:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788748567.339478:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788748567.339490:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788748567.339504:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788748567.339519:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788748567.339531:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788748567.339547:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788748567.339563:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788748567.339595:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788748567.339614:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788748567.339630:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788748567.339645:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788748567.339656:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788748567.340827:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788748567.340849:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788748567.340862:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788748567.340875:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788748567.340888:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788748567.340900:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788748567.340914:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788748567.340927:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788748567.340950:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788748567.340962:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788748567.340987:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788748567.341015:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788748567.341031:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788748567.341447:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788748567.341472:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788748567.341485:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788748567.341497:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788748567.341509:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788748567.341523:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788748567.341538:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788748567.341552:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788748567.341565:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788748567.341577:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788748567.341589:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788748567.341602:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788748567.341613:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788748567.341626:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788748567.341656:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788748567.341748:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788748567.341764:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788748567.341777:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788748567.341830:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748567.341900:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.341953:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748567.342799:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694272 00000100:00100000:1.0:1788748567.342808:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694272 00000100:00100000:1.0:1788748567.342873:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788748567.342884:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748567.343026:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694272:12345-0@lo:502:mount.lustre.0 Request processed in 145us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748567.343034:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788748567.343145:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748567.343339:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788748567.343363:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788748567.343390:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748567.343436:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.343474:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748567.343479:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694400 00000100:00100000:1.0:1788748567.343486:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694400 00000100:00100000:1.0:1788748567.343512:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748567.343520:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748567.343611:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694400:12345-0@lo:502:mount.lustre.0 Request processed in 90us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748567.343619:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788748567.343803:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748567.343840:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788748567.343848:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788748567.347945:0:17937:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788748567.347963:0:17937:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8adc825d0000) 00000020:00000080:2.0:1788748567.347996:0:17937:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788748567.355980:0:17937:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8add913f3000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788748567.355990:0:17937:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8add913f3000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788748567.355993:0:17937:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8add913f3000 3 00010000:00080000:1.0:1788748567.356029:0:17937:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8add842be000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748567.358505:0:17937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788748567.360364:0:17937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788748567.360422:0:17937:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788748567.360435:0:17937:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9ba0f20a02e1b242 00000100:00080000:1.0:1788748567.360445:0:17937:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748567.360457:0:17937:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8add842be000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748567.360492:0:17937:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842f8a80 x1875638388694528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788748567.360538:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388694528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788748567.360600:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748567.360655:0:17937:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788748567.360876:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694528 00000100:00100000:0.0:1788748567.360884:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694528 00000100:00100000:0.0:1788748567.360915:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748567.360922:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875638388694528:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788748567.360945:0:17184:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1788748567.361002:0:17184:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9ba0f20a02e1b249 00000004:00100000:0.0:1788748567.361017:0:17184:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788748567.361044:0:17184:0:(import.c:65:import_set_state_nolock()) ffff8adc83e53000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748567.361101:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875638388694528:12345-0@lo:38:llog_process_th.0 Request processed in 177us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.361109:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788748567.361173:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc842f8a80 x1875638388694528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748567.361183:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748567.361190:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788748567.361197:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788748567.361201:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788748567.361203:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add842be000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788748567.361209:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875638388694528:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788748567.363399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748567.363406:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748567.363409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748567.363412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788748567.363758:0:17937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788748567.363909:0:17917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788748567.363937:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788748567.363959:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76600/0x9ba0f20a02e1b22d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b234 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.363978:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76600/0x9ba0f20a02e1b22d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b234 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788748567.364025:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788748567.364028:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748567.364029:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748567.364030:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748567.364031:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748567.364032:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748567.364033:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748567.364035:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748567.364036:0:17917:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748567.364040:0:17917:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788748567.364042:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748567.364043:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748567.364044:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748567.364045:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748567.364046:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748567.364047:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748567.364048:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748567.364049:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748567.364050:0:17917:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748567.364074:0:17917:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788748567.364092:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788748567.364159:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.364192:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba59ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.365748:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694656 00000100:00100000:0.0:1788748567.365759:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694656 00000100:00100000:0.0:1788748567.365804:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788748567.365813:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add96c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788748567.365846:0:17179:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788748567.365858:0:17179:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788748567.370691:0:17165:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788748567.370764:0:17179:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788748567.370783:0:17179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788748567.370877:0:17201:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788748567.370882:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788748567.370903:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.370922:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.370946:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.370953:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.371017:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.371032:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 18 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748567.371048:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388694784:0@lo:104: 00000100:00100000:0.0:1788748567.371112:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748567.371167:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.371175:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 18 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748567.371185:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388694912:0@lo:104: 00000100:00100000:0.0:1788748567.371207:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748567.371224:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777300 going to sleep for 11 seconds 00000100:00100000:3.0:1788748567.371394:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694784 00000100:00100000:3.0:1788748567.371413:0:17169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694784 00000100:00100000:3.0:1788748567.371448:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388694912 00000100:00100000:3.0:1788748567.371452:0:17169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388694912 00000100:00100000:3.0:1788748567.371466:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748567.371474:0:17169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:17201:x1875638388694784:12345-0@lo:104: 00010000:00010000:3.0:1788748567.371485:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.371537:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788748567.371543:0:17169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:17201:x1875638388694784:12345-0@lo:104: Request processed in 70us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748567.371549:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748567.371562:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748567.371568:0:17169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388694912:12345-0@lo:104: 00010000:00010000:3.0:1788748567.371575:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748567.371608:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788748567.371613:0:17169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388694912:12345-0@lo:104: Request processed in 46us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748567.371618:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748567.371831:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add96c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17917:x1875638388694656:12345-0@lo:253:mount.lustre.0 Request processed in 6019us (7671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748567.371849:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788748567.371910:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:17917:1875638388694656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788748567.371920:0:17917:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788748567.371923:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788748567.371924:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788748567.371925:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748567.371926:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748567.371928:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748567.371929:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748567.371930:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788748567.371932:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748567.371933:0:17917:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788748567.371949:0:17917:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788748567.373570:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748567.373582:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373593:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748567.373597:0:17173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373607:0:17173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748567.373615:0:17173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748567.373639:0:17173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748567.373680:0:17173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373688:0:17173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748567.373710:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373716:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b218 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373732:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748567.373736:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373741:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bde00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748567.373744:0:17173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373750:0:17173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748567.373756:0:17173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748567.373760:0:17173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748567.373772:0:17173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373777:0:17173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748567.373800:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373807:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add912bde00/0x9ba0f20a02e1b14d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b154 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.373821:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748567.373823:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748567.373825:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748567.373843:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388695040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748567.373909:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748567.373966:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388695168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748567.374001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748567.374108:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695040 00000100:00100000:2.0:1788748567.374115:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695040 00010000:00010000:2.0:1788748567.374143:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 18 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748567.374166:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695168 00000100:00100000:2.0:1788748567.374169:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695168 00010000:00010000:2.0:1788748567.374178:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 19 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748567.374191:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748567.374198:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:3638:x1875638388695040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748567.374210:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748567.374214:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 19 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374226:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 19 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374249:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748567.374281:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:3638:x1875638388695040:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.374289:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748567.374304:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748567.374311:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3635:x1875638388695168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748567.374336:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748567.374341:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 18 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374350:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 18 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374362:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374370:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748567.374385:0:17170:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010187036s 00010000:00010000:2.0:1788748567.374389:0:17170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374396:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374403:0:17170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374519:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374524:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940600 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748567.374528:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374536:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374545:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748567.374554:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748567.374584:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3635:x1875638388695168:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.374591:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788748567.374629:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388695040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748567.374651:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388695168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748567.375186:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bc000/0x9ba0f20a02e1b218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b211 expref: 17 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748567.375199:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388694784:0@lo:104: 00010000:00010000:0.0:1788748567.375210:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b14d expref: 16 pid: 17180 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748567.375227:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388694912:0@lo:104: 00010000:00010000:0.0:1788748567.375246:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.375255:0:17201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.375261:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748567.375268:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b250 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748567.376178:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788748567.381137:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788748567.381657:0:17943:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788748567.381995:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788748567.382456:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17944:1875638388695296:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788748567.382521:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.382545:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc8427ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.382648:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695296 00000100:00100000:2.0:1788748567.382655:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695296 00000100:00100000:2.0:1788748567.382712:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748567.382721:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17944:x1875638388695296:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788748567.382799:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17944:x1875638388695296:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.382808:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:2.0:1788748567.382931:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788748567.382965:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788748567.383711:0:17917:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788748567.383720:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788748567.383763:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788748567.384540:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788748567.386581:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17944:1875638388695296:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788748567.386625:0:17944:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788748567.386688:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17944:1875638388695424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788748567.386748:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.386783:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc8427ecc0 going to sleep for 11 seconds 00000020:00080000:1.0:1788748567.387781:0:17942:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788748567.387786:0:17942:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788748567.388003:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788748567.388081:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695424 00000100:00100000:2.0:1788748567.388089:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695424 00000100:00100000:2.0:1788748567.388144:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748567.388154:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17944:x1875638388695424:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788748567.388309:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17944:x1875638388695424:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 157us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.388344:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:0.0:1788748567.388988:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788748567.389038:0:17943:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788748567.389561:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17944:1875638388695424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788748567.389644:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17944:1875638388695552:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788748567.389806:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748567.389834:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc8427e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788748567.390182:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695552 00000100:00100000:0.0:1788748567.390189:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695552 00000100:00100000:0.0:1788748567.390243:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748567.390252:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1875638388695552:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788748567.390378:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1875638388695552:12345-0@lo:900:lod0001_rec0000.0 Request processed in 127us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748567.390386:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788748567.390875:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788748567.390927:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788748567.391287:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788748567.392036:0:17917:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1788748567.393952:0:17917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:1.0:1788748567.394100:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8adc825c1500 x1875638388695552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788748583 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748567.394117:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c1500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17944:1875638388695552:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788748567.394278:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17944:1875638388695680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788748567.394604:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748567.394639:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777780 going to sleep for 11 seconds 00000100:00100000:2.0:1788748567.394736:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695680 00000100:00100000:2.0:1788748567.394743:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695680 00000100:00100000:2.0:1788748567.394789:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748567.394797:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17944:x1875638388695680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788748567.394907:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17944:x1875638388695680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748567.394914:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748567.395033:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17944:1875638388695680:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788748567.395081:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748567.397964:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788748567.398053:0:17944:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788748567.398058:0:17944:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788748567.410531:0:17917:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788748567.410582:0:17917:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaf7081b1f988 00100000:10000000:2.0:1788748567.410592:0:17917:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788748567.412438:0:17917:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788748567.412480:0:17917:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788748567.412500:0:17917:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788748567.412524:0:17917:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788748567.413277:0:17917:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788748567.413559:0:17917:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788748567.464979:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748567.911899:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00000040:00080000:3.0:1788748568.421030:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748568.485512:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788748568.868400:0:17182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788748568.868422:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add913f3000 from 8 10000000:01000000:2.0:1788748568.868427:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788748568.868488:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748568.868501:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748568.868515:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748568.868557:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388695808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748568.868649:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748568.868713:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add96e6e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748568.868824:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695808 00000100:00100000:1.0:1788748568.868834:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695808 00000100:00100000:1.0:1788748568.868898:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748568.868920:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add96c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+16:17182:x1875638388695808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748568.868938:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748568.868956:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b257 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.868995:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 17 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.869010:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 17 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.869020:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68000, rc 0) 00000100:00100000:1.0:1788748568.869072:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add96c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388695808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748568.869081:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748568.869139:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388695808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748568.869155:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.869164:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748568.869235:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388695936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788748568.869266:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748568.869288:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3c0bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748568.872699:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388695936 00000100:00100000:2.0:1788748568.872715:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388695936 00000100:00100000:2.0:1788748568.872790:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788748568.872803:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add813ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388695936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788748568.872847:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788748568.872868:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788748568.872871:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788748568.873054:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add813ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388695936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 253us (3785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748568.873063:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748568.875469:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388695936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788748568.875971:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788748568.875985:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.876000:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748568.876012:0:17182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788748568.876014:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc848d0800 from 8 10000000:01000000:1.0:1788748568.876018:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788748568.876059:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.876068:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.876078:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748568.876104:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388696064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748568.876944:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748568.877023:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3bacf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748568.877446:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696064 00000100:00100000:0.0:1788748568.877459:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696064 00000100:00100000:0.0:1788748568.877545:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788748568.877558:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add888c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388696064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748568.877580:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748568.877602:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b265 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748568.877638:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748568.877650:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 18 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748568.877662:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940e00, rc 0) 00000100:00100000:0.0:1788748568.877746:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add888c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388696064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748568.877754:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748568.878385:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388696064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748568.878410:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.878422:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748568.878512:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388696192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788748568.878648:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748568.878694:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3bacf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748568.878767:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696192 00000100:00100000:3.0:1788748568.878775:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696192 00000100:00100000:3.0:1788748568.878822:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788748568.878830:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add888c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388696192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788748568.878851:0:17177:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748568.878870:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748568.878874:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788748568.879151:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add888c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388696192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 319us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748568.879160:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788748568.879975:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388696192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788748568.880047:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788748568.880058:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748568.880071:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748568.933719:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00000040:00080000:3.0:1788748569.447112:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788748569.508645:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748569.956442:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:1.0:1788748570.532717:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748570.981413:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00010000:00010000:1.0:1788748571.560931:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788748571.713279:0:18187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788748572.004370:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 0 seconds 00000100:00080000:2.0:1788748572.452482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788748572.452489:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788748572.452493:0:8:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748572.452508:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8addb3926000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748572.452546:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e6680 x1875638388696448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748572.452568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748572.452572:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748572.452574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748572.452577:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748572.452600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748572.452603:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748572.452606:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748572.452608:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788748572.452640:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388696320:0@lo:400:kworker.0 00000100:00100000:2.0:1788748572.452652:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388696448:0@lo:38:kworker.0 00000100:00100000:3.0:1788748572.452761:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388696576:0@lo:400:kworker.0 00000100:00100000:1.0:1788748572.454472:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388696832:0@lo:400:kworker.0 00000100:00100000:2.0:1788748572.461602:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748572.462386:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748572.462419:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748572.462431:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388696704:0@lo:400:kworker.0 00000100:00100000:3.0:1788748572.462461:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748572.464166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748572.464281:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696320 00000100:00100000:0.0:1788748572.464288:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696320 00000100:00100000:0.0:1788748572.464347:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788748572.464357:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3636:x1875638388696320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748572.464420:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3636:x1875638388696320:12345-0@lo:400:kworker.0 Request processed in 65us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748572.464428:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788748572.464467:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388696960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748572.464600:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696576 00000100:00100000:3.0:1788748572.464605:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696576 00000100:00100000:3.0:1788748572.464632:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788748572.464639:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388696576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748572.464677:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388696576:12345-0@lo:400:kworker.0 Request processed in 39us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748572.464690:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788748572.464722:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc843e5880 x1875638388696576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748572.464978:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748572.465006:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388696320:0@lo:400:kworker.0 00000100:00100000:0.0:1788748572.465031:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696448 00000100:00100000:0.0:1788748572.465035:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696448 00000100:00100000:0.0:1788748572.465047:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696704 00000100:00100000:0.0:1788748572.465050:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696704 00000100:00100000:0.0:1788748572.465062:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696960 00000100:00100000:0.0:1788748572.465065:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696960 00000100:00100000:0.0:1788748572.465076:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788748572.465080:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875638388696448:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788748572.465105:0:17190:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1788748572.465140:0:17190:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e1b273 00000004:00100000:0.0:1788748572.465156:0:17190:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788748572.465161:0:17190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788748572.465265:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388696576:0@lo:400:kworker.0 00000100:00100000:3.0:1788748572.465303:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748572.465311:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1875638388696704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748572.465874:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1875638388696704:12345-0@lo:400:kworker.0 Request processed in 562us (3409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748572.466013:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788748572.466036:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748572.466042:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388696960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788748572.466064:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788748572.466103:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388696960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748572.466109:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748572.466146:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388696960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748572.466726:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748572.467138:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388696704:0@lo:400:kworker.0 00000100:00100000:3.0:1788748572.467854:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388696832 00000100:00100000:3.0:1788748572.467862:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388696832 00000100:00100000:3.0:1788748572.468025:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748572.468033:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388696832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748572.468099:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388696832:12345-0@lo:400:kworker.0 Request processed in 67us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748572.468106:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788748572.468800:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc843e6a00 x1875638388696832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748572.468814:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388696832:0@lo:400:kworker.0 00000100:00080000:0.0:1788748572.486726:0:17190:0:(import.c:65:import_set_state_nolock()) ffff8addbc782800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748572.486843:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1875638388696448:12345-0@lo:38:kworker.0 Request processed in 21758us (25245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748572.486852:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788748572.486958:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788748572.486967:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788748572.486973:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788748572.486976:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addb3926000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788748572.486998:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000061c516df): req@ffff8adc825c0000 x1875638388689536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748572.487024:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388696448:0@lo:38:kworker.0 00000100:00100000:3.0:1788748572.487201:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748572.487264:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82da8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748572.487347:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388689536 00000100:00100000:2.0:1788748572.487354:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388689536 00000100:00100000:2.0:1788748572.487398:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748572.487407:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17227:x1875638388689536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788748572.487486:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17227:x1875638388689536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748572.487493:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748572.487526:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17227:1875638388689536:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788748572.487556:0:17227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788748572.487586:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17227:1875638388697216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788748572.487587:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388697088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748572.487616:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748572.487642:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf4773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748572.487642:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697216 00000100:00100000:0.0:1788748572.487651:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697216 00000100:00100000:2.0:1788748572.487656:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748572.487667:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697088 00000100:00100000:0.0:1788748572.487669:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697088 00000100:00100000:2.0:1788748572.487678:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748572.487683:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17227:x1875638388697216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788748572.487990:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17227:x1875638388697216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 306us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748572.488040:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17227:1875638388697216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788748572.488100:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17227:1875638388697344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788748572.488125:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748572.488139:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748572.488152:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697344 00000100:00100000:3.0:1788748572.488155:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697344 00000100:00100000:0.0:1788748572.498744:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748572.498769:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3637:x1875638388697088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748572.498810:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788748572.499356:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3637:x1875638388697088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 597us (11696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748572.499365:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788748572.500242:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388697088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748572.500590:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788748572.500626:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748572.500638:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17227:x1875638388697344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788748572.500757:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17227:x1875638388697344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 123us (12631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748572.500765:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748572.500799:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17227:1875638388697344:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788748572.501089:0:17227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748572.506130:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788748572.506222:0:17227:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788748572.506227:0:17227:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788748572.581505:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788748572.688348:0:18239:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748572.688515:0:18239:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788748573.604564:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788748573.782429:0:18290:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748573.782753:0:18290:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748574.631771:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788748574.806863:0:18338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcaf6bf300 20000000:00000080:1.0:1788748574.806879:0:18338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8add842e3800 uarg=0000000000000000 20000000:01000000:1.0:1788748574.806932:0:18338:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788748574.806945:0:18338:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788748574.806950:0:18338:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788748574.807718:0:18339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788748574.808060:0:18338:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788748574.817703:0:18338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788748574.817734:0:18338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.817773:0:18338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.817781:0:18338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.817788:0:18338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.817830:0:18338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.817845:0:18338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748574.817859:0:18338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18338:1875638388697472:0@lo:104: 00000100:00100000:3.0:1788748574.818434:0:18338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748574.818477:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697472 00000100:00100000:1.0:1788748574.818484:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697472 00010000:00010000:3.0:1788748574.818498:0:18338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.818507:0:18338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 17 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748574.818515:0:18338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18338:1875638388697600:0@lo:104: 00000100:00100000:1.0:1788748574.818536:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748574.818540:0:18338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748574.818545:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:18338:x1875638388697472:12345-0@lo:104: 00000100:00100000:3.0:1788748574.818549:0:18338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82daef00 going to sleep for 11 seconds 00010000:00010000:1.0:1788748574.818569:0:17168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748574.818632:0:17168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748574.818638:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:18338:x1875638388697472:12345-0@lo:104: Request processed in 96us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748574.818645:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748574.818662:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697600 00000100:00100000:1.0:1788748574.818666:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697600 00000100:00100000:1.0:1788748574.818681:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748574.818687:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:18338:x1875638388697600:12345-0@lo:104: 00010000:00010000:1.0:1788748574.818700:0:17168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748574.818743:0:17168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748574.818752:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:18338:x1875638388697600:12345-0@lo:104: Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748574.818758:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748574.818804:0:18338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18338:1875638388697472:0@lo:104: 00000100:00100000:3.0:1788748574.818812:0:18338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18338:1875638388697600:0@lo:104: 00010000:00010000:3.0:1788748574.818831:0:18338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.818886:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748574.818892:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.818900:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748574.818904:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.818912:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748574.818919:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748574.818949:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788748574.818988:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.818994:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748574.819017:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.819024:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b21f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b226 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.819038:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748574.819041:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.819046:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941600 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748574.819049:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.819056:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748574.819062:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748574.819067:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788748574.819077:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788748574.819079:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.819085:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788748574.819088:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388697728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748574.819107:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748574.819113:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b11c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b123 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748574.819116:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788748574.819127:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748574.819129:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748574.819142:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748574.819142:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388697856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748574.819172:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748574.819683:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748574.820753:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697728 00000100:00100000:1.0:1788748574.820902:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697856 00000100:00100000:1.0:1788748574.820911:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697856 00010000:00010000:1.0:1788748574.820953:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 18 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748574.821030:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748574.821040:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3635:x1875638388697856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748574.821055:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748574.821061:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 18 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748574.821071:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 18 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748574.821088:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d77400/0x9ba0f20a02e1b123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b11c expref: 18 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748574.821101:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748574.821174:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:3635:x1875638388697856:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748574.821181:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748574.821700:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388697856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748574.822027:0:17172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697728 00010000:00010000:3.0:1788748574.822992:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748574.823055:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748574.823064:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:3637:x1875638388697728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788748574.823079:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748574.823085:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823096:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823114:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b21f expref: 17 pid: 17179 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823130:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823149:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823166:0:17172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823172:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823179:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823186:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823202:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748574.823223:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.823231:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748574.823759:0:18338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748574.823773:0:18338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.825912:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.825942:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bd200/0x9ba0f20a02e1b27a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748574.825964:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748574.826049:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f35c4edf-1df7-4d0c-8881-06ee23716a92+16:3637:x1875638388697728:12345-0@lo:103:ldlm_bl.0 Request processed in 2984us (6929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748574.826060:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748574.826162:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388697728:0@lo:103:ldlm_bl.0 00000040:00080000:1.0:1788748575.015973:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748575.652900:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748576.676403:0:17182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788748576.676420:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add913f3000 from 13 10000000:01000000:0.0:1788748576.676425:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748576.676471:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748576.676483:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748576.676495:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748576.676525:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388697984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748576.676534:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748576.676601:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748576.676648:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748576.676767:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388697984 00000100:00100000:1.0:1788748576.676780:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388697984 00000100:00100000:1.0:1788748576.676936:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788748576.676948:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+16:17182:x1875638388697984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748576.676971:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748576.676994:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b281 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748576.677027:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748576.677041:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748576.677918:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68600, rc 0) 00000100:00100000:1.0:1788748576.678114:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388697984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1165us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748576.678123:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788748576.686035:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388697984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748576.686788:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748576.688851:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748576.689024:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748576.689128:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748576.689200:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748576.689840:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388698112 00000100:00100000:1.0:1788748576.689856:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388698112 00000100:00100000:1.0:1788748576.689938:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788748576.689949:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388698112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748576.690176:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388698112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748576.690184:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788748576.690407:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748576.690460:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748576.690507:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748576.690537:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8676c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788748576.690590:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388698240 00000100:00100000:1.0:1788748576.690599:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388698240 00000100:00100000:1.0:1788748576.690634:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748576.690642:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388698240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748576.690718:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388698240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748576.690725:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748576.690803:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788748576.706201:0:18408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788748576.708193:0:17182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788748576.708229:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748576.708241:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748576.708254:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748576.708470:0:17182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788748576.708473:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc848d0800 from 13 10000000:01000000:0.0:1788748576.708476:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748576.708520:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748576.708529:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748576.708539:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748576.708564:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748576.708638:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748576.708728:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748576.709524:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388698368 00000100:00100000:2.0:1788748576.709532:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388698368 00000100:00100000:3.0:1788748576.709637:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788748576.709651:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+17:17182:x1875638388698368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748576.709666:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748576.709681:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b28f expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748576.709714:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748576.709724:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748576.709748:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d76a00, rc 0) 00000100:00100000:3.0:1788748576.709813:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388698368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748576.709820:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788748576.709961:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748576.709977:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748576.709986:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748576.710048:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748576.710088:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748576.710217:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777840 going to sleep for 11 seconds 00000100:00100000:3.0:1788748576.713259:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388698496 00000100:00100000:3.0:1788748576.713285:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388698496 00000100:00100000:3.0:1788748576.713551:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788748576.713560:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388698496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748576.713878:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388698496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748576.713888:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788748576.719529:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748576.719595:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748576.719667:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748576.719765:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777840 going to sleep for 11 seconds 00000100:00100000:3.0:1788748576.719978:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388698624 00000100:00100000:3.0:1788748576.719985:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388698624 00000100:00100000:3.0:1788748576.720087:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788748576.720097:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388698624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748576.720234:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:17182:x1875638388698624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748576.720242:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748576.720351:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388698624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788748576.721049:0:18410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788748576.721097:0:17182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788748576.721118:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748576.721128:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748576.721140:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748577.572947:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748567/real 1788748567] req@ffff8adc842fb100 x1875638388692736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748577.572976:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc842fb100 x1875638388692736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748577.572986:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748567/real 1788748567] req@ffff8adc842fa300 x1875638388692608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748577.573000:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc842fa300 x1875638388692608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748577.573031:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788748577.573171:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388698752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748577.573306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748577.573372:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388698752 00000100:00100000:2.0:1788748577.573381:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388698752 00000100:00100000:2.0:1788748577.573548:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788748577.573559:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388698752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748577.573595:0:17926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788748577.573637:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388698752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748577.573644:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788748577.573686:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388698752:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788748577.577878:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748577.577888:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388692736:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788748577.577898:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add84d0a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748577.577916:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748577.577920:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388692608:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788748577.577962:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388698880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748577.578024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748577.578073:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388698880 00000100:00100000:0.0:1788748577.578080:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388698880 00000100:00100000:0.0:1788748577.578118:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748577.578125:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388698880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748577.578157:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788748577.578221:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388698880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748577.578228:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748577.578268:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388698880:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788748577.578501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748577.578506:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748577.578509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748577.578512:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748577.578530:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748577.578534:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788748577.578536:0:8:0:(import.c:65:import_set_state_nolock()) ffff8add84d0a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748577.578540:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1788748577.578544:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788748577.578552:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8add84d0a800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748577.578572:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e6d80 x1875638388699264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748577.578610:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748577.578613:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788748577.578614:0:8:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748577.578617:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1788748577.578619:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788748577.578624:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8add842b8800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748577.578636:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e5880 x1875638388699392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748577.578663:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388699520:0@lo:400:kworker.0 00000100:00100000:2.0:1788748577.578698:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748577.578720:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748577.578726:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388699136:0@lo:400:kworker.0 00000100:00100000:2.0:1788748577.578746:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748577.578777:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388699520 00000100:00100000:2.0:1788748577.578781:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388699520 00000100:00100000:2.0:1788748577.578806:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388699136 00000100:00100000:2.0:1788748577.578809:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388699136 00000100:00100000:2.0:1788748577.578821:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748577.578826:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388699520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748577.578862:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388699520:12345-0@lo:400:kworker.0 Request processed in 35us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748577.578868:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748577.578880:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748577.578885:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388699136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748577.578922:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875638388699136:12345-0@lo:400:kworker.0 Request processed in 37us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748577.578934:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788748577.578969:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc843e5f80 x1875638388699136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748577.579111:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875638388699136:0@lo:400:kworker.0 00010000:00080000:2.0:1788748577.579125:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc843e6680 x1875638388699520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748577.579133:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388699520:0@lo:400:kworker.0 00000100:00100000:2.0:1788748577.579148:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748577.579153:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388699008:0@lo:400:kworker.0 00000100:00100000:2.0:1788748577.579183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748577.579219:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388699008 00000100:00100000:2.0:1788748577.579229:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388699008 00000100:00100000:2.0:1788748577.579255:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788748577.579261:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3637:x1875638388699008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748577.579295:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3637:x1875638388699008:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748577.579301:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788748577.579421:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388699264:0@lo:8:kworker.0 00000400:00000100:0.0:1788748577.579447:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388699264 offset 0 length 520: 4 00000100:00100000:0.0:1788748577.579466:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388699392:0@lo:8:kworker.0 00000400:00000100:0.0:1788748577.579484:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388699392 offset 0 length 520: 4 00000100:00100000:2.0:1788748577.580771:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388699008:0@lo:400:kworker.0 00010000:00010000:1.0:1788748577.700609:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788748578.099922:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788748578.599403:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748563/real 1788748563] req@ffff8adc843e4000 x1875638388690688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748578 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748578.599452:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e4000 x1875638388690688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748578 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748578.599463:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748563/real 1788748563] req@ffff8adc843e4700 x1875638388690816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748578 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748578.599473:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e4700 x1875638388690816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748578 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788748578.599507:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addae418000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748578.599528:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748578.599532:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690688:0@lo:8:kworker.0 00000100:00080000:0.0:1788748578.599537:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add83fbb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748578.599542:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788748578.599544:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388690816:0@lo:8:kworker.0 00000100:00080000:2.0:1788748578.599775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748578.599780:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788748578.599783:0:38:0:(import.c:65:import_set_state_nolock()) ffff8addae418000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748578.599788:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1788748578.599793:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788748578.599809:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8addae418000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748578.599830:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8407ca80 x1875638388699904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748578.599842:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748578.599845:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788748578.599847:0:38:0:(import.c:65:import_set_state_nolock()) ffff8add83fbb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748578.599850:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1788748578.599852:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788748578.599856:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8add83fbb000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748578.599867:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8407ea00 x1875638388700032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748578.599907:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748578.599910:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748578.599912:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748578.599915:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748578.599940:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388700160:0@lo:400:kworker.0 00000100:00100000:2.0:1788748578.600012:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748578.600042:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748578.600047:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388700288:0@lo:400:kworker.0 00000100:00100000:2.0:1788748578.600073:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748578.600103:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388700160 00000100:00100000:2.0:1788748578.600110:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388700160 00000100:00100000:2.0:1788748578.600154:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748578.600163:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388700160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748578.600231:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388700160:12345-0@lo:400:kworker.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748578.600239:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748578.600262:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388700288 00000100:00100000:2.0:1788748578.600265:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388700288 00000100:00100000:2.0:1788748578.600287:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748578.600294:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388700288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748578.600350:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388700288:12345-0@lo:400:kworker.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748578.600357:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748578.600390:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388700288:0@lo:400:kworker.0 00010000:00080000:2.0:1788748578.600401:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc8407c000 x1875638388700160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748578.600410:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388700160:0@lo:400:kworker.0 00000100:00100000:0.0:1788748578.600857:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388699648:0@lo:400:kworker.0 00000100:00100000:0.0:1788748578.600904:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748578.600944:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388700416:0@lo:400:kworker.0 00000100:00100000:0.0:1788748578.600973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748578.600996:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788748578.601001:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388699776:0@lo:400:kworker.0 00000100:00100000:0.0:1788748578.601024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748578.601053:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388699776 00000100:00100000:0.0:1788748578.601057:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388699776 00000100:00100000:0.0:1788748578.601101:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748578.601108:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388699776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748578.601152:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388699776:12345-0@lo:400:kworker.0 Request processed in 45us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748578.601159:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788748578.601269:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388699648 00000100:00100000:3.0:1788748578.601274:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388699648 00000100:00100000:3.0:1788748578.601299:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788748578.601305:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3637:x1875638388699648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748578.601355:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:3637:x1875638388699648:12345-0@lo:400:kworker.0 Request processed in 51us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748578.601361:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788748578.601631:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388699904:0@lo:8:kworker.0 00000400:00000100:0.0:1788748578.601656:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388699904 offset 0 length 520: 4 00000100:00100000:0.0:1788748578.601678:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388700032:0@lo:8:kworker.0 00000400:00000100:0.0:1788748578.601695:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875638388700032 offset 0 length 520: 4 00000100:00100000:0.0:1788748578.601731:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388699776:0@lo:400:kworker.0 00000100:00100000:2.0:1788748578.601826:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388700416 00000100:00100000:2.0:1788748578.601831:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388700416 00000100:00100000:2.0:1788748578.601868:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748578.601875:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388700416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748578.601919:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388700416:12345-0@lo:400:kworker.0 Request processed in 45us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748578.601925:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788748578.602384:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388699648:0@lo:400:kworker.0 00010000:00080000:0.0:1788748578.602404:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc8407ce00 x1875638388700416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748578.602413:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388700416:0@lo:400:kworker.0 00010000:00010000:1.0:1788748578.724857:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748579.692530:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748579.748924:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748580.772457:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788748581.506802:0:18686:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788748581.506806:0:18686:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788748581.506807:0:18686:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788748581.506921:0:18686:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8add84308800 00000020:01000004:2.0:1788748581.506937:0:18686:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788748581.506955:0:18686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788748581.506969:0:18686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8adc825d3380) 00000020:00000080:2.0:1788748581.506985:0:18686:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788748581.540503:0:18686:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788748581.542190:0:18686:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788748581.542641:0:18686:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788748581.542912:0:18686:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788748581.543135:0:18686:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788748581.543397:0:18686:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788748581.543651:0:18686:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788748581.544850:0:18686:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788748581.545050:0:18686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788748581.545062:0:18686:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788748581.545074:0:18686:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9ba0f20a02e1b2a4 00000020:01000004:2.0:1788748581.545080:0:18686:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788748581.545101:0:18686:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788748581.545104:0:18686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788748581.545110:0:18686:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788748581.545114:0:18686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788748581.545125:0:18686:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8adc825d19c0) 00000020:00000080:2.0:1788748581.545151:0:18686:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788748581.546386:0:18686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748581.546574:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788748581.546581:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788748581.551483:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748581.551495:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788748581.551912:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788748581.551919:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788748581.555082:0:18686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748581.555280:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788748581.555288:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788748581.556497:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788748581.556507:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788748581.571834:0:18686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748581.572078:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788748581.572084:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788748581.573283:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788748581.573293:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788748581.574279:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788748581.574288:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788748581.576290:0:18686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788748581.576759:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788748581.576766:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788748581.577436:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788748581.577444:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788748581.613733:0:18686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788748581.614760:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788748581.614769:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788748581.619103:0:18686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788748581.619115:0:18686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788748581.620557:0:18686:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788748581.620586:0:18686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788748581.620593:0:18686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788748581.642923:0:18686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788748581.642970:0:18686:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788748581.642975:0:18686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788748581.642976:0:18686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788748581.642977:0:18686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748581.642979:0:18686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748581.642980:0:18686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748581.642981:0:18686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748581.642982:0:18686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748581.642984:0:18686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748581.642985:0:18686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788748581.642989:0:18686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788748581.642991:0:18686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788748581.642992:0:18686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788748581.642998:0:18686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748581.642999:0:18686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748581.643000:0:18686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748581.643001:0:18686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748581.643002:0:18686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748581.643003:0:18686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748581.643004:0:18686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788748581.643032:0:18686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788748581.643052:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788748581.643145:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748581.643198:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8676ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748581.643357:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388700544 00000100:00100000:3.0:1788748581.643365:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388700544 00000100:00100000:3.0:1788748581.643423:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788748581.643433:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:18686:x1875638388700544:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788748581.643471:0:17177:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788748581.643475:0:17177:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788748581.643478:0:17177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788748581.644037:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:18686:x1875638388700544:12345-0@lo:253:mount.lustre.0 Request processed in 602us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748581.644046:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788748581.644137:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748581.644147:0:18686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788748581.644150:0:18686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748581.644151:0:18686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788748581.644152:0:18686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748581.644153:0:18686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748581.644154:0:18686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748581.644156:0:18686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748581.644157:0:18686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748581.644158:0:18686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748581.644159:0:18686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788748581.644179:0:18686:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8add84308800 from lustre-OST0000 10000000:01000000:0.0:1788748581.644207:0:18686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788748581.644210:0:18686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788748581.644218:0:18686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adc840f99c0 local copy 00010000:00010000:0.0:1788748581.644228:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748581.644362:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748581.644407:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748581.644448:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8676c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788748581.644556:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388700672 00000100:00100000:2.0:1788748581.644562:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388700672 00000100:00100000:2.0:1788748581.644617:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788748581.644625:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:18686:x1875638388700672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748581.644693:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:18686:x1875638388700672:12345-0@lo:501:mount.lustre.0 Request processed in 69us (286us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748581.644700:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788748581.644835:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700672:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788748581.644849:0:18686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788748581.644868:0:18686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788748581.644885:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.644894:0:18686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748581.644917:0:18686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8add84308800 10000000:01000000:1.0:1788748581.644922:0:18686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788748581.644927:0:18686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788748581.644930:0:18686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788748581.644934:0:18686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788748581.644937:0:18686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788748581.644959:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68c00/0x9ba0f20a02e1b2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.644966:0:18686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a68c00/0x9ba0f20a02e1b2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.644983:0:18686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a68c00/0x9ba0f20a02e1b2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748581.644996:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788748581.645027:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748581.645052:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.645186:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388700800 00000100:00100000:0.0:1788748581.645191:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388700800 00000100:00100000:0.0:1788748581.645229:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788748581.645237:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+18:18686:x1875638388700800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748581.645246:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748581.645257:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941800/0x9ba0f20a02e1b2b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b2b2 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.645278:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941800/0x9ba0f20a02e1b2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b2b2 expref: 19 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.645289:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941800/0x9ba0f20a02e1b2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b2b2 expref: 19 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.645297:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941800, rc 0) 00000100:00100000:0.0:1788748581.645361:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388700800:12345-0@lo:101:mount.lustre.0 Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.645367:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788748581.645502:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748581.645515:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a68c00/0x9ba0f20a02e1b2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2b9 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.645524:0:18686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68c00/0x9ba0f20a02e1b2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b2b9 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748581.646927:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788748581.647713:0:18686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748581.652041:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788748581.652177:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788748581.652197:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788748581.652213:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788748581.652226:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788748581.652240:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788748581.652265:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788748581.652272:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788748581.652630:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748581.652702:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748581.652794:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.652837:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388700928 00000100:00100000:0.0:1788748581.652845:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388700928 00000100:00100000:0.0:1788748581.652944:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788748581.652954:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388700928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748581.653113:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388700928:12345-0@lo:501:mount.lustre.0 Request processed in 159us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.653120:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788748581.653190:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388700928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748581.653236:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748581.653276:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748581.653746:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748581.653820:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701056 00000100:00100000:3.0:1788748581.653826:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701056 00000100:00100000:3.0:1788748581.653853:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788748581.653861:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388701056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788748581.654740:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388701056:12345-0@lo:503:mount.lustre.0 Request processed in 876us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748581.654750:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788748581.654868:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788748581.655288:0:18686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748581.655554:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748581.655677:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748581.655757:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.655825:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701184 00000100:00100000:0.0:1788748581.655831:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701184 00000100:00100000:2.0:1788748581.655920:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788748581.655932:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388701184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.656550:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388701184:12345-0@lo:502:mount.lustre.0 Request processed in 619us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.656559:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788748581.656650:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748581.656839:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788748581.656868:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788748581.656895:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788748581.656911:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788748581.656925:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788748581.656938:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788748581.656952:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788748581.656967:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788748581.656997:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788748581.657013:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788748581.657028:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788748581.657057:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788748581.657163:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748581.657222:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748581.657550:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748581.657663:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701312 00000100:00100000:2.0:1788748581.657668:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701312 00000100:00100000:2.0:1788748581.657695:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788748581.657703:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388701312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.657796:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388701312:12345-0@lo:502:mount.lustre.0 Request processed in 94us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.657804:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788748581.657899:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748581.657944:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788748581.657961:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788748581.659209:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788748581.659218:0:18703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788748581.659224:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748581.659227:0:18703:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788748581.659233:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788748581.659248:0:18703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8addb5b1cd40) 00000020:00000080:3.0:1788748581.659270:0:18703:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788748581.659277:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788748581.659504:0:18703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8add84308800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788748581.659512:0:18703:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788748581.659520:0:18703:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9ba0f20a02e1b2c7 00010000:00010000:3.0:1788748581.663904:0:18703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788748581.664660:0:18703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788748581.666553:0:18703:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788748581.667774:0:18703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788748581.667787:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748581.667803:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748581.667805:0:18703:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788748581.667814:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788748581.667817:0:18703:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788748581.667819:0:18703:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788748581.667820:0:18703:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788748581.667822:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788748581.667825:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748581.667826:0:18703:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788748581.667829:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748581.667832:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748581.667833:0:18703:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788748581.667836:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788748581.667838:0:18703:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788748581.667840:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748581.667843:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748581.667844:0:18703:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788748581.667846:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788748581.667848:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748581.667850:0:18703:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788748581.667853:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788748581.667888:0:18703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788748581.667892:0:18703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788748581.667894:0:18703:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788748581.667898:0:18703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788748581.670204:0:18686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788748581.670255:0:18686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788748581.670275:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68c00/0x9ba0f20a02e1b2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2b9 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748581.670288:0:18686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a68c00/0x9ba0f20a02e1b2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2b9 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748581.670305:0:18686:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add84308800 from 1 10000000:01000000:3.0:1788748581.670308:0:18686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748581.670364:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748581.670373:0:18686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748581.670466:0:18686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748581.670490:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748581.670557:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748581.670665:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86840 going to sleep for 11 seconds 00000100:00100000:2.0:1788748581.671736:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701440 00000100:00100000:2.0:1788748581.671746:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701440 00000100:00100000:2.0:1788748581.672483:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788748581.672495:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:18686:x1875638388701440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748581.672512:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748581.672528:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b2ce expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.672554:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 20 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.672583:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 20 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.672593:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bd600, rc 0) 00000100:00100000:2.0:1788748581.672661:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701440:12345-0@lo:101:mount.lustre.0 Request processed in 170us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.672668:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788748581.674262:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748581.674285:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748581.674297:0:18686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748581.675714:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788748581.675980:0:18686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748581.676285:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788748581.676311:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788748581.676688:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788748581.676694:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788748581.676766:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748581.676837:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748581.676892:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.677193:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701568 00000100:00100000:0.0:1788748581.677201:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701568 00000100:00100000:0.0:1788748581.677283:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788748581.677293:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748581.677543:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701568:12345-0@lo:501:mount.lustre.0 Request processed in 251us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.677551:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788748581.678411:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748581.678463:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748581.678522:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.678557:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701696 00000100:00100000:2.0:1788748581.678563:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701696 00000100:00100000:2.0:1788748581.678613:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788748581.678622:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701696:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748581.678709:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701696:12345-0@lo:503:mount.lustre.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.678716:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788748581.678766:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82daef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788748581.678780:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788748581.679407:0:18686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748581.679489:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.679532:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.679655:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701824 00000100:00100000:2.0:1788748581.679660:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701824 00000100:00100000:2.0:1788748581.679702:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788748581.679708:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.679788:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701824:12345-0@lo:502:mount.lustre.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.679795:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788748581.679833:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748581.679847:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748581.680059:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788748581.680166:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788748581.680188:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788748581.680202:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788748581.680216:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788748581.680230:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788748581.680257:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788748581.680273:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788748581.680289:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788748581.680303:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788748581.680341:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788748581.680366:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.680557:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.680658:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388701952 00000100:00100000:2.0:1788748581.680663:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388701952 00000100:00100000:2.0:1788748581.680729:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788748581.680737:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.680820:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388701952:12345-0@lo:502:mount.lustre.0 Request processed in 83us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.680827:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788748581.680883:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748581.680905:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388701952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748581.680946:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788748581.680954:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788748581.682754:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748581.682765:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682767:0:18707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788748581.682774:0:18707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8add84308800 00000020:00000080:1.0:1788748581.682776:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748581.682783:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748581.682786:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682787:0:18707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788748581.682789:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748581.682791:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682793:0:18707:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788748581.682868:0:18707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8add84308800 00000020:00000080:1.0:1788748581.682872:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748581.682929:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748581.682932:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682934:0:18707:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788748581.682936:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748581.682938:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682939:0:18707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748581.682942:0:18707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8add84308800 00000020:00000080:1.0:1788748581.682944:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748581.682960:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748581.682962:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682963:0:18707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788748581.682966:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788748581.682968:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682970:0:18707:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788748581.682973:0:18707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8add84308800 00000020:00000080:1.0:1788748581.682975:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788748581.682994:0:18707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788748581.682996:0:18707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748581.682998:0:18707:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788748581.683000:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788748581.683187:0:18686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788748581.683984:0:18686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748581.684008:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.684109:0:18686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748581.684165:0:18686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788748581.684168:0:18686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8add84308800 10000000:01000000:2.0:1788748581.684172:0:18686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8add84308800 10000000:01000000:2.0:1788748581.684176:0:18686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788748581.684181:0:18686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8add84308800 from 1 10000000:01000000:2.0:1788748581.684184:0:18686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788748581.684540:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bc000/0x9ba0f20a02e1b2dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.684550:0:18686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add912bc000/0x9ba0f20a02e1b2dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.684560:0:18686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add912bc000/0x9ba0f20a02e1b2dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748581.684584:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748581.684645:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.684698:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788748581.686008:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702080 00000100:00100000:3.0:1788748581.686020:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702080 00000100:00100000:3.0:1788748581.686077:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788748581.686159:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:18686:x1875638388702080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748581.686177:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748581.686193:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1b2e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b2dc expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748581.686219:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1b2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b2dc expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748581.686229:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77a00/0x9ba0f20a02e1b2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b2dc expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748581.686237:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77a00, rc 0) 00000100:00100000:3.0:1788748581.686307:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702080:12345-0@lo:101:mount.lustre.0 Request processed in 222us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748581.686313:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788748581.686433:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748581.686455:0:18686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add912bc000/0x9ba0f20a02e1b2dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2e3 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.686464:0:18686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add912bc000/0x9ba0f20a02e1b2dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b2e3 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748581.687663:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788748581.687912:0:18686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748581.688386:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788748581.688414:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788748581.688429:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788748581.688443:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788748581.688456:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788748581.688469:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788748581.688481:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788748581.688494:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788748581.688506:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788748581.688519:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788748581.688531:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788748581.688543:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788748581.688555:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788748581.689013:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788748581.689032:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788748581.689043:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788748581.689054:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788748581.689064:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788748581.689074:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788748581.689094:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788748581.689110:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788748581.689125:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788748581.689136:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788748581.689152:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788748581.689176:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788748581.689190:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788748581.689204:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788748581.689216:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788748581.689228:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788748581.689254:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788748581.689268:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788748581.689280:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788748581.689292:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788748581.689305:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788748581.689341:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788748581.689358:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788748581.689372:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788748581.689393:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788748581.689399:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788748581.689488:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748581.689552:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.689609:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748581.689609:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702208 00000100:00100000:1.0:1788748581.689616:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702208 00000100:00100000:1.0:1788748581.689662:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788748581.689672:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748581.689792:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702208:12345-0@lo:501:mount.lustre.0 Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748581.689952:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788748581.691951:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748581.692004:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748581.692257:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.692299:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.692744:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702336 00000100:00100000:0.0:1788748581.692752:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702336 00000100:00100000:0.0:1788748581.692862:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788748581.692886:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748581.693017:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702336:12345-0@lo:503:mount.lustre.0 Request processed in 142us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.693026:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788748581.693031:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702336:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788748581.693428:0:18686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748581.693505:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.693544:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.693572:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.693647:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702464 00000100:00100000:0.0:1788748581.693652:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702464 00000100:00100000:0.0:1788748581.693677:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788748581.693683:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748581.693758:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702464:12345-0@lo:502:mount.lustre.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.693765:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788748581.693770:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748581.693934:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788748581.693958:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788748581.693971:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788748581.693996:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788748581.694010:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788748581.694022:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788748581.694034:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788748581.694046:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788748581.694060:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788748581.694073:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788748581.694086:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788748581.694100:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788748581.694112:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788748581.694123:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788748581.694135:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788748581.694147:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788748581.694161:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788748581.694175:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788748581.694187:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788748581.694213:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788748581.694227:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788748581.694240:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788748581.694254:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788748581.694268:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788748581.694282:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788748581.694296:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788748581.694309:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788748581.694344:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788748581.694359:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788748581.694373:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788748581.694386:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788748581.694400:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788748581.694423:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788748581.694437:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788748581.694451:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788748581.694474:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788748581.694489:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788748581.694501:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788748581.694514:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788748581.694526:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788748581.694538:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788748581.694549:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788748581.694561:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788748581.694574:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788748581.694588:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788748581.694600:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788748581.694612:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788748581.694627:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788748581.694659:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.694704:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.694732:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.695071:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702592 00000100:00100000:0.0:1788748581.695077:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702592 00000100:00100000:0.0:1788748581.695188:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788748581.695197:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788748581.695308:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702592:12345-0@lo:502:mount.lustre.0 Request processed in 112us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.695333:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788748581.695666:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748581.695821:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788748581.695846:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788748581.695892:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748581.695992:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.697916:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748581.698135:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702720 00000100:00100000:1.0:1788748581.698143:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702720 00000100:00100000:1.0:1788748581.698192:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788748581.698201:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748581.698348:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388702720:12345-0@lo:502:mount.lustre.0 Request processed in 148us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748581.698356:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788748581.698514:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388702720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748581.698583:0:18686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788748581.698596:0:18686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788748581.699855:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788748581.699872:0:18711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8adc83b13380) 00000020:00000080:1.0:1788748581.700089:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788748581.700166:0:18711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8add84308800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788748581.700170:0:18711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8add84308800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788748581.700173:0:18711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8add84308800 3 00010000:00080000:1.0:1788748581.700200:0:18711:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc8256c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748581.709755:0:18711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788748581.710981:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788748581.711397:0:18711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788748581.711413:0:18711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9ba0f20a02e1b2f1 00000100:00080000:0.0:1788748581.711424:0:18711:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788748581.711436:0:18711:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8adc8256c000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788748581.711470:0:18711:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc8380e300 x1875638388702848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788748581.711508:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388702848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788748581.711626:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788748581.711695:0:18711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788748581.711748:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.711757:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748581.711759:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.711762:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788748581.711782:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388702976:0@lo:400:kworker.0 00000100:00080000:2.0:1788748581.711787:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.711789:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748581.711791:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.711794:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748581.711889:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388703360:0@lo:400:kworker.0 00000100:00100000:2.0:1788748581.711913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748581.711933:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.711946:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388703104:0@lo:400:kworker.0 00000100:00100000:0.0:1788748581.711965:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702976 00000100:00100000:2.0:1788748581.711966:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748581.711971:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702976 00000100:00100000:2.0:1788748581.711982:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788748581.711987:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388703232:0@lo:400:kworker.0 00000100:00100000:2.0:1788748581.712005:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748581.712005:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748581.712014:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388702976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748581.712084:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388702848 00000100:00100000:3.0:1788748581.712089:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388702848 00000100:00100000:3.0:1788748581.712102:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388703360 00000100:00100000:3.0:1788748581.712105:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388703360 00000100:00100000:3.0:1788748581.712120:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388703104 00000100:00100000:3.0:1788748581.712121:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388703104 00000100:00100000:3.0:1788748581.712132:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748581.712138:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388703360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748581.713124:0:17185:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788748581.713134:0:17185:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788748581.713150:0:17184:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788748581.713161:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788748581.713169:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388703104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748581.713332:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388702976:12345-0@lo:400:kworker.0 Request processed in 1304us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.713341:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748581.713360:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388703232 00000100:00100000:0.0:1788748581.713365:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388703232 00000100:00100000:0.0:1788748581.713383:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748581.713389:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388703232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748581.713425:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388703232:12345-0@lo:400:kworker.0 Request processed in 36us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.713431:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788748581.713470:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388702976:0@lo:400:kworker.0 00000020:01000004:1.0:1788748581.713819:0:18711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788748581.713834:0:18711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8add885b8000) 00000020:00000080:1.0:1788748581.713855:0:18711:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788748581.713943:0:18711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8add84308800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788748581.713947:0:18711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8add84308800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788748581.713955:0:18711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8add84308800 3 00010000:00080000:1.0:1788748581.713982:0:18711:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc8256f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788748581.715562:0:18711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788748581.715739:0:18711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788748581.715775:0:18711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788748581.715786:0:18711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9ba0f20a02e1b2ff 00000100:00080000:1.0:1788748581.715795:0:18711:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788748581.715807:0:18711:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8adc8256f000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748581.715841:0:18711:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842f8e00 x1875638388703488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788748581.716395:0:18711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788748581.716513:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388703360:12345-0@lo:400:kworker.0 Request processed in 4372us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748581.716534:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788748581.716561:0:17186:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748581.716571:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788748581.716577:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875638388702848:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788748581.716600:0:17186:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1788748581.716633:0:17186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9ba0f20a02e1b306 00000004:00100000:3.0:1788748581.716647:0:17186:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1788748581.716668:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc8407dc00 x1875638388703360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788748581.716672:0:17186:0:(import.c:65:import_set_state_nolock()) ffff8add8435f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788748581.716680:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388703360:0@lo:400:kworker.0 00000100:00100000:3.0:1788748581.716715:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875638388702848:12345-0@lo:38:llog_process_th.0 Request processed in 138us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748581.716722:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788748581.717479:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875638388703488:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788748581.717540:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788748581.717597:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc8380e300 x1875638388702848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748581.717607:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748581.717614:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788748581.717622:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788748581.717626:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788748581.717628:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc8256c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788748581.717634:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875638388702848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788748581.718117:0:17186:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748581.718127:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388703488 00000100:00100000:3.0:1788748581.718132:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388703488 00000100:00100000:3.0:1788748581.718152:0:17186:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788748581.718160:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748581.718166:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875638388703488:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788748581.718190:0:17186:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1788748581.718230:0:17186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9ba0f20a02e1b30d 00000004:00100000:3.0:1788748581.718242:0:17186:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788748581.718269:0:17186:0:(import.c:65:import_set_state_nolock()) ffff8add84358800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748581.718415:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875638388703488:12345-0@lo:38:llog_process_th.0 Request processed in 247us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748581.718423:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788748581.719401:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388703104:12345-0@lo:400:kworker.0 Request processed in 6229us (7430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.719413:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788748581.719660:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.719666:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748581.719672:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.719675:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748581.719679:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.719682:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748581.719684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748581.719687:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748581.719728:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388703232:0@lo:400:kworker.0 00010000:00080000:2.0:1788748581.719742:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc8407f100 x1875638388703104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748581.719753:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388703104:0@lo:400:kworker.0 00000040:00080000:2.0:1788748581.720062:0:18711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788748581.720194:0:18686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788748581.720224:0:18686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788748581.720243:0:18686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bc000/0x9ba0f20a02e1b2dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2e3 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.720254:0:18686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add912bc000/0x9ba0f20a02e1b2dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b2e3 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788748581.720403:0:18686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788748581.720405:0:18686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748581.720407:0:18686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748581.720408:0:18686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748581.720409:0:18686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748581.720411:0:18686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748581.720412:0:18686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748581.720419:0:18686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748581.720420:0:18686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748581.720424:0:18686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788748581.720426:0:18686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788748581.720427:0:18686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788748581.720428:0:18686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748581.720429:0:18686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748581.720430:0:18686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748581.720431:0:18686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748581.720432:0:18686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748581.720433:0:18686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748581.720434:0:18686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788748581.720455:0:18686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788748581.720470:0:18686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388703616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788748581.720519:0:18686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.720552:0:18686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748581.721485:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388703616 00000100:00100000:1.0:1788748581.721496:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388703616 00000100:00100000:1.0:1788748581.721549:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788748581.721557:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388703616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788748581.721583:0:17179:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788748581.721597:0:17179:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788748581.722973:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8adc842f8e00 x1875638388703488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748581.722987:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748581.723004:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788748581.723012:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788748581.723017:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788748581.723021:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc8256f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788748581.723029:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875638388703488:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788748581.723399:0:17179:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788748581.723415:0:17179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788748581.723666:0:17201:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788748581.723671:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788748581.723691:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.723707:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.723716:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.723724:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.723760:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 21 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.723775:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 21 pid: 17180 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748581.723788:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388703744:0@lo:104: 00000100:00100000:1.0:1788748581.723845:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788748581.723916:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748581.723916:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388703744 00000100:00100000:0.0:1788748581.723922:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388703744 00010000:00010000:1.0:1788748581.723924:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 21 pid: 17177 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748581.723932:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388703872:0@lo:104: 00000100:00100000:1.0:1788748581.723956:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748581.723966:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaafe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748581.723967:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788748581.723976:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388703872 00000100:00100000:0.0:1788748581.723979:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388703872 00000100:00100000:0.0:1788748581.723995:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788748581.724003:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:17201:x1875638388703744:12345-0@lo:104: 00010000:00010000:0.0:1788748581.724016:0:17168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.724076:0:17168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748581.724082:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:17201:x1875638388703744:12345-0@lo:104: Request processed in 81us (238us total) trans 0 rc 0/0 00010000:00010000:2.0:1788748581.724098:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748581.724104:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.724111:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69c00 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:2.0:1788748581.724114:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.724122:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788748581.724129:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748581.724135:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748581.724162:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.724178:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748581.724199:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.724206:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b26c expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.724217:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748581.724219:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748581.724221:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748581.724230:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748581.724237:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388704000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748581.724248:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788748581.724254:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388703872:12345-0@lo:104: 00010000:00010000:0.0:1788748581.724262:0:17168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748581.724265:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748581.724297:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704000 00000100:00100000:2.0:1788748581.724301:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704000 00010000:00010000:0.0:1788748581.724912:0:17168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788748581.724921:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388703872:12345-0@lo:104: Request processed in 666us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.724936:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788748581.725042:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748581.725048:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.725056:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:0.0:1788748581.725060:0:17173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.725068:0:17173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788748581.725074:0:17173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748581.725079:0:17173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788748581.725186:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 22 pid: 17180 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748581.725221:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748581.725231:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:3638:x1875638388704000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748581.725243:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748581.725247:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 22 pid: 17180 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.725251:0:17173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.725257:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 22 pid: 17180 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.725257:0:17173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788748581.725271:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748581.725272:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.725278:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b25e expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748581.725290:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748581.725311:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:3638:x1875638388704000:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.725342:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748581.725369:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388704128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748581.725374:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748581.725376:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748581.725405:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748581.725421:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:18686:x1875638388703616:12345-0@lo:253:mount.lustre.0 Request processed in 3865us (4903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748581.725434:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788748581.725446:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704128 00000100:00100000:2.0:1788748581.725451:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704128 00010000:00010000:2.0:1788748581.725465:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 21 pid: 17177 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748581.725483:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748581.725490:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3635:x1875638388704128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788748581.725497:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748581.725500:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 21 pid: 17177 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.725509:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 21 pid: 17177 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.725522:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.725529:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788748581.725544:0:17171:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010187036s 00010000:00010000:2.0:1788748581.725548:0:17171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.725555:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748581.726440:0:18686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:18686:1875638388703616:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748581.726454:0:18686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788748581.726458:0:18686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748581.726460:0:18686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788748581.726461:0:18686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748581.726462:0:18686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748581.726463:0:18686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748581.726464:0:18686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748581.726466:0:18686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748581.726468:0:18686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748581.726470:0:18686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1788748581.726479:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.726486:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1788748581.726486:0:18686:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788748581.726492:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748581.726495:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.726503:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.726513:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748581.726523:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788748581.726761:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3635:x1875638388704128:12345-0@lo:103:ldlm_bl.0 Request processed in 1270us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748581.726770:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748581.729704:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388704128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788748581.729816:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388704000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748581.729971:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940e00/0x9ba0f20a02e1b26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b265 expref: 20 pid: 17180 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748581.729986:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388703744:0@lo:104: 00010000:00010000:1.0:1788748581.729998:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b257 expref: 19 pid: 17177 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748581.730007:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388703872:0@lo:104: 00010000:00010000:1.0:1788748581.730025:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.730035:0:17201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.730041:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748581.730047:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc83a69400/0x9ba0f20a02e1b314 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788748581.732843:0:18686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788748581.738055:0:18686:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788748581.738065:0:18686:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788748581.741667:0:18686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788748581.741715:0:18686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788748581.741734:0:18686:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788748581.741755:0:18686:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788748581.743997:0:18686:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748581.744352:0:18686:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788748581.798136:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788748582.484906:0:18766:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748582.485122:0:18766:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788748582.692786:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748582.692808:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388704384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748582.692892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748582.692924:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388704256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748582.692941:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704384 00000100:00100000:2.0:1788748582.692949:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704384 00000100:00100000:3.0:1788748582.692975:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748582.694444:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704256 00000100:00100000:2.0:1788748582.694455:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704256 00000100:00100000:2.0:1788748582.694502:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748582.694511:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388704384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748582.694546:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788748582.694624:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388704384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748582.694631:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748582.694649:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748582.694655:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388704256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748582.694672:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788748582.694708:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388704384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748582.694717:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388704256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748582.694724:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748582.694830:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388704256:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788748582.823366:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788748583.205940:0:17182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788748583.205948:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add913f3000 from 9 10000000:01000000:1.0:1788748583.205952:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788748583.205996:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748583.206007:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748583.206031:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748583.206057:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748583.206913:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748583.206962:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaafa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788748583.207050:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704512 00000100:00100000:2.0:1788748583.207059:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704512 00000100:00100000:2.0:1788748583.207104:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788748583.207115:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+19:17182:x1875638388704512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748583.207304:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748583.207336:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b31b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.207362:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 20 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.207374:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 20 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.207394:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bce00, rc 0) 00000100:00100000:2.0:1788748583.207456:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:17182:x1875638388704512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748583.207463:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788748583.207812:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748583.207910:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748583.207921:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748583.207983:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788748583.208031:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748583.208074:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748583.208082:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704640 00000100:00100000:1.0:1788748583.208088:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704640 00000100:00100000:1.0:1788748583.208198:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788748583.208207:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:17182:x1875638388704640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788748583.208224:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788748583.208240:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788748583.208244:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788748583.208363:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:17182:x1875638388704640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748583.208371:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788748583.208695:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788748583.208991:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788748583.209000:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748583.209009:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748583.209018:0:17182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748583.209021:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc848d0800 from 9 10000000:01000000:0.0:1788748583.209023:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748583.209046:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748583.209054:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748583.209062:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748583.209337:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748583.209410:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748583.209450:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748583.210342:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704768 00000100:00100000:2.0:1788748583.210351:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704768 00000100:00100000:2.0:1788748583.210391:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788748583.210398:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:17182:x1875638388704768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748583.210412:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748583.210427:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b329 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.210450:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.210460:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 21 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.210469:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add912bc600, rc 0) 00000100:00100000:2.0:1788748583.210516:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388704768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748583.210522:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788748583.210562:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748583.210576:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.210597:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748583.210654:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788748583.210688:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748583.210704:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbc777180 going to sleep for 11 seconds 00000100:00100000:2.0:1788748583.210716:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388704896 00000100:00100000:2.0:1788748583.210719:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388704896 00000100:00100000:2.0:1788748583.210736:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788748583.210741:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388704896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788748583.210754:0:17177:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788748583.210769:0:17177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788748583.210772:0:17177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788748583.210854:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388704896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748583.210861:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788748583.210900:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388704896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788748583.210955:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788748583.210962:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748583.210969:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748583.845274:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748584.871616:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788748585.253978:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748585.912632:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788748586.788645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748586.788659:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748586.788662:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748586.788665:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748586.788682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748586.788685:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748586.788688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748586.788691:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788748586.791340:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388705024:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.791420:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748586.791610:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388705536:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.791641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748586.791672:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788748586.791679:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388705408:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.791705:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748586.791740:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388705152:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.791761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748586.791781:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388705664:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.791805:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748586.791823:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748586.791830:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388705280:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.791863:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748586.791880:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388705792:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.791914:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748586.791947:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705408 00000100:00100000:2.0:1788748586.791956:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705408 00000100:00100000:2.0:1788748586.791994:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705152 00000100:00100000:2.0:1788748586.791997:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705152 00000100:00100000:2.0:1788748586.792011:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748586.792018:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388705408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.792083:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388705408:12345-0@lo:400:kworker.0 Request processed in 52us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748586.792089:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748586.792106:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788748586.793424:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705536 00000100:00100000:0.0:1788748586.793433:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705536 00000100:00100000:0.0:1788748586.793465:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705664 00000100:00100000:0.0:1788748586.793468:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705664 00000100:00100000:0.0:1788748586.793503:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705280 00000100:00100000:0.0:1788748586.793506:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705280 00000100:00100000:0.0:1788748586.793518:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705792 00000100:00100000:0.0:1788748586.793520:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705792 00000100:00100000:0.0:1788748586.793538:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748586.793545:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388705536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748586.793607:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388705536:12345-0@lo:400:kworker.0 Request processed in 63us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748586.793613:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788748586.794299:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748586.794309:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388705664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748586.794384:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388705664:12345-0@lo:400:kworker.0 Request processed in 76us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748586.794391:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788748586.794405:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748586.794412:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388705280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748586.794440:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388705280:12345-0@lo:400:kworker.0 Request processed in 30us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748586.794446:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788748586.794457:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748586.794463:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388705792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748586.794504:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388705792:12345-0@lo:400:kworker.0 Request processed in 41us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748586.794510:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788748586.794550:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748586.794553:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788748586.794587:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc8407f100 x1875638388705280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748586.794609:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388705280:0@lo:400:kworker.0 00010000:00080000:0.0:1788748586.795091:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc8407fb80 x1875638388705792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748586.795111:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388705792:0@lo:400:kworker.0 00010000:00080000:0.0:1788748586.795132:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc8407ce00 x1875638388705664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748586.795141:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388705664:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.795175:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388705152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748586.795182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388705408:0@lo:400:kworker.0 00010000:00080000:0.0:1788748586.795193:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc8407c000 x1875638388705536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748586.795201:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388705536:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.795230:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388705152:12345-0@lo:400:kworker.0 Request processed in 3118us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748586.795237:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388705152:0@lo:400:kworker.0 00000100:00100000:2.0:1788748586.795238:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788748586.798719:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705024 00000100:00100000:3.0:1788748586.798735:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705024 00000100:00100000:3.0:1788748586.798800:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788748586.798810:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3638:x1875638388705024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748586.798920:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3638:x1875638388705024:12345-0@lo:400:kworker.0 Request processed in 111us (7498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748586.798928:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788748586.798991:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388705024:0@lo:400:kworker.0 00010000:00010000:2.0:1788748586.916466:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788748587.494725:0:19056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788748587.812557:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748587.812578:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388705920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748587.812671:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748587.812711:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388705920 00000100:00100000:0.0:1788748587.812717:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388705920 00000100:00100000:0.0:1788748587.812760:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748587.812767:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388705920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748587.812797:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788748587.812846:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388705920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748587.812868:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788748587.812915:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388705920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748587.813580:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748587.813592:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388706048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748587.813627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748587.813659:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706048 00000100:00100000:2.0:1788748587.813664:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706048 00000100:00100000:2.0:1788748587.813689:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748587.813696:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388706048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748587.813716:0:17926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788748587.813745:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388706048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748587.813751:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788748587.813786:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388706048:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788748587.941559:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788748588.383683:0:19108:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748588.383971:0:19108:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788748588.964850:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788748589.302982:0:19158:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748589.303217:0:19158:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788748589.924955:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788748589.988909:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748591.016406:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788748591.909613:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748591.909620:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788748591.909623:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748591.909627:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788748591.909652:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748591.909655:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788748591.909658:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788748591.909661:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788748591.909732:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388706304:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.909829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748591.909882:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388706816:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.909909:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748591.909946:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788748591.909952:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388706176:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.909985:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748591.910009:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388706688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.910039:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748591.910065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388706432:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.910590:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748591.910618:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388706944:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.910646:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748591.910665:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748591.910670:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388706560:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.910796:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748591.910840:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706304 00000100:00100000:3.0:1788748591.910847:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706304 00000100:00100000:3.0:1788748591.910883:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706560 00000100:00100000:3.0:1788748591.910887:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706560 00000100:00100000:3.0:1788748591.910902:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748591.910910:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388706304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911074:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388706304:12345-0@lo:400:kworker.0 Request processed in 107us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748591.911081:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788748591.911098:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748591.911104:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388706560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911147:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388706560:12345-0@lo:400:kworker.0 Request processed in 44us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748591.911153:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788748591.911171:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706176 00000100:00100000:3.0:1788748591.911174:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706176 00000100:00100000:3.0:1788748591.911198:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788748591.911215:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3636:x1875638388706176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911246:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3636:x1875638388706176:12345-0@lo:400:kworker.0 Request processed in 33us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748591.911253:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788748591.911261:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706816 00000100:00100000:0.0:1788748591.911267:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706816 00000100:00100000:3.0:1788748591.911285:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706688 00000100:00100000:3.0:1788748591.911290:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706688 00000100:00100000:0.0:1788748591.911306:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706432 00000100:00100000:0.0:1788748591.911311:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706432 00000100:00100000:3.0:1788748591.911313:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388706944 00000100:00100000:3.0:1788748591.911336:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388706944 00000100:00100000:0.0:1788748591.911351:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788748591.911362:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388706816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911368:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788748591.911378:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388706688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748591.911413:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388706816:12345-0@lo:400:kworker.0 Request processed in 53us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748591.911422:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875638388706688:12345-0@lo:400:kworker.0 Request processed in 45us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748591.911423:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748591.911433:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748591.911448:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788748591.911455:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748591.911459:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388706432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911465:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388706944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911566:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388706944:12345-0@lo:400:kworker.0 Request processed in 103us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748591.911572:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788748591.911622:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388706560:0@lo:400:kworker.0 00010000:00080000:3.0:1788748591.911635:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc825c2300 x1875638388706432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748591.911653:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388706432:0@lo:400:kworker.0 00010000:00080000:3.0:1788748591.911664:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc8493b480 x1875638388706944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748591.911673:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388706944:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911841:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388706176:0@lo:400:kworker.0 00010000:00080000:3.0:1788748591.911853:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc825c0000 x1875638388706688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748591.911862:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875638388706688:0@lo:400:kworker.0 00000100:00100000:3.0:1788748591.911871:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388706304:0@lo:400:kworker.0 00010000:00080000:3.0:1788748591.911880:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc8493bb80 x1875638388706816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748591.911888:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388706816:0@lo:400:kworker.0 00000100:00080000:1.0:1788748591.913431:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748591.913440:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748591.914171:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388706432:12345-0@lo:400:kworker.0 Request processed in 2708us (4077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748591.914185:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788748592.036491:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748592.934567:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388707072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748592.934636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.934735:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707072 00000100:00100000:2.0:1788748592.934742:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707072 00000100:00100000:2.0:1788748592.934793:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788748592.934812:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388707072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748592.934846:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788748592.934891:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388707072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.934898:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788748592.934998:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388707072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748592.940666:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388707200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748592.940733:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.940789:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707200 00000100:00100000:2.0:1788748592.940796:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707200 00000100:00100000:2.0:1788748592.940858:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748592.940866:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388707200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748592.940902:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788748592.940944:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388707200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.940951:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788748592.941016:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388707200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748592.997279:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748577/real 1788748577] req@ffff8adc843e6d80 x1875638388699264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748592.997311:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e6d80 x1875638388699264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748592.997364:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748577/real 1788748577] req@ffff8adc843e5880 x1875638388699392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748592.997396:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc843e5880 x1875638388699392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788748592.997416:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add84d0a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748592.997438:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788748592.997441:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388699264:0@lo:8:kworker.0 00000100:00080000:1.0:1788748592.997447:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788748592.997452:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788748592.997455:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388699392:0@lo:8:kworker.0 00000100:00080000:2.0:1788748592.997582:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748592.997585:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748592.997589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748592.997597:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748592.997619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748592.997622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788748592.997625:0:8:0:(import.c:65:import_set_state_nolock()) ffff8add84d0a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748592.997630:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1788748592.997635:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788748592.997644:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8add84d0a800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748592.997664:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843e6d80 x1875638388707584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748592.997676:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748592.997679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788748592.997680:0:8:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748592.997683:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1788748592.997685:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788748592.997695:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8add842b8800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748592.997708:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc840bb100 x1875638388707712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748592.997754:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388707968:0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.997822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.997853:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748592.997859:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388707328:0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.997886:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.997922:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388708096:0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.997943:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.997984:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388707456:0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998008:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.998027:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748592.998037:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388707840:0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998058:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.998086:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707968 00000100:00100000:2.0:1788748592.998094:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707968 00000100:00100000:2.0:1788748592.998128:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708096 00000100:00100000:2.0:1788748592.998131:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708096 00000100:00100000:2.0:1788748592.998143:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707456 00000100:00100000:2.0:1788748592.998145:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707456 00000100:00100000:2.0:1788748592.998167:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707840 00000100:00100000:2.0:1788748592.998170:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707840 00000100:00100000:2.0:1788748592.998185:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748592.998194:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388707968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998245:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388707968:12345-0@lo:400:kworker.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.998251:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788748592.998266:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748592.998273:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388708096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998300:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388708096:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.998306:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748592.998339:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748592.998346:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388707456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998378:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388707456:12345-0@lo:400:kworker.0 Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.998393:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788748592.998406:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748592.998412:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388707840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998440:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388707840:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.998446:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788748592.998464:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707328 00000100:00100000:2.0:1788748592.998467:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707328 00000100:00100000:2.0:1788748592.998492:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788748592.998499:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3635:x1875638388707328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998529:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3635:x1875638388707328:12345-0@lo:400:kworker.0 Request processed in 31us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.998535:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788748592.998584:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840b9c00 x1875638388707840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748592.998595:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388707840:0@lo:400:kworker.0 00010000:00080000:2.0:1788748592.998606:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc843e5880 x1875638388707456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748592.998614:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388707456:0@lo:400:kworker.0 00000100:00100000:2.0:1788748592.998638:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388707584:0@lo:8:kworker.0 00000100:00100000:2.0:1788748592.998667:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.998692:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388707712:0@lo:8:kworker.0 00000100:00100000:2.0:1788748592.998717:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748592.998764:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707584 00000100:00100000:2.0:1788748592.998768:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707584 00000100:00100000:2.0:1788748592.998783:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388707712 00000100:00100000:2.0:1788748592.998785:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388707712 00000100:00100000:2.0:1788748592.998794:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748592.998810:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875638388707584:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788748592.998832:0:18690:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1788748592.998859:0:18690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e1b337 00002000:00100000:2.0:1788748592.998871:0:18690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8add8595d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788748592.998876:0:18690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788748592.998879:0:18690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788748592.999037:0:18690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788748592.999060:0:18690:0:(import.c:65:import_set_state_nolock()) ffff8add8595c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748592.999097:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875638388707584:12345-0@lo:8:kworker.0 Request processed in 296us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748592.999103:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788748592.999116:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748592.999120:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875638388707712:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788748592.999131:0:18690:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788748593.000858:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f35c4edf-1df7-4d0c-8881-06ee23716a92:3635:1875638388707328:0@lo:400:kworker.0 00010000:00080000:0.0:1788748593.000877:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840b9880 x1875638388708096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748593.000889:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388708096:0@lo:400:kworker.0 00010000:00080000:0.0:1788748593.000899:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840b9500 x1875638388707968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748593.000922:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388707968:0@lo:400:kworker.0 00010000:00080000:0.0:1788748593.000968:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc843e6d80 x1875638388707584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748593.000976:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788748593.000984:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788748593.000992:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788748593.000997:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788748593.001000:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add84d0a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788748593.001012:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788748593.001018:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388707584:0@lo:8:kworker.0 00000004:00080000:1.0:1788748593.001173:0:17928:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788748593.001196:0:17928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17928:1875638388708352:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788748593.001243:0:17928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748593.001266:0:17928:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118c00 going to sleep for 11 seconds 00000004:00080000:1.0:1788748593.001281:0:17927:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788748593.001429:0:17927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 509988111399ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788748593.001436:0:17927:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788748593.001716:0:18693:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788748593.001724:0:18693:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788748593.001749:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388708224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748593.001782:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748593.001833:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708224 00000100:00100000:0.0:1788748593.001839:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708224 00000100:00100000:0.0:1788748593.001884:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788748593.001893:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875638388708224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788748593.001917:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788748593.001957:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875638388708224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.001963:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788748593.001982:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788748593.002002:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc842f9880 x1875638388708224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748593.002032:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388708224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748593.005720:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708352 00000100:00100000:0.0:1788748593.005731:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708352 00000100:00100000:1.0:1788748593.007791:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748593.007818:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17928:x1875638388708352:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788748593.010049:0:17918:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788748593.011246:0:19357:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788748593.011254:0:19357:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788748593.011416:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17928:x1875638388708352:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3601us (10169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.011427:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788748593.011509:0:17928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc842f8000 x1875638388708352/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748609 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748593.011524:0:17928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17928:1875638388708352:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788748593.011538:0:17928:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788748593.011573:0:17928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17928:1875638388708480:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788748593.011617:0:17928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748593.011646:0:17928:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add86118c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788748593.011719:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708480 00000100:00100000:0.0:1788748593.011726:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708480 00000100:00100000:0.0:1788748593.011771:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748593.011781:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17928:x1875638388708480:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788748593.011813:0:18693:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788748593.011850:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17928:x1875638388708480:12345-0@lo:5:osp-pre-0-1.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748593.011856:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788748593.012038:0:17928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc842f8000 x1875638388708480/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748609 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748593.012048:0:17928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17928:1875638388708480:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788748593.012057:0:17928:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788748593.012083:0:17928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17928:1875638388708608:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788748593.012117:0:17928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748593.012141:0:17928:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84279240 going to sleep for 11 seconds 00000100:00100000:1.0:1788748593.012234:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708608 00000100:00100000:1.0:1788748593.012239:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708608 00000100:00100000:1.0:1788748593.012272:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788748593.012279:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17928:x1875638388708608:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788748593.012303:0:19357:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788748593.022481:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875638388707712:12345-0@lo:8:kworker.0 Request processed in 23354us (23757us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788748593.022495:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788748593.022689:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788748593.022696:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788748593.022700:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388707712:0@lo:8:kworker.0 00000001:00080000:0.0:1788748593.053435:0:18687:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788748593.053452:0:18687:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788748593.056212:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17928:x1875638388708608:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43925us (44087us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788748593.056227:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788748593.056642:0:17928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc8493b480 x1875638388708608/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748609 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748593.056656:0:17928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788748593.056664:0:17928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17928:1875638388708608:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788748593.056701:0:17928:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788748593.056766:0:17928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17928:1875638388708736:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788748593.056821:0:17928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748593.056855:0:17928:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748593.056884:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708736 00000100:00100000:3.0:1788748593.056892:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708736 00000100:00100000:3.0:1788748593.056932:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788748593.056941:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17928:x1875638388708736:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788748593.056991:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17928:x1875638388708736:12345-0@lo:900:osp-pre-0-1.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748593.056999:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788748593.057016:0:17928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840b8a80 x1875638388708736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788748609 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748593.057028:0:17928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17928:1875638388708736:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788748593.060866:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748594.089653:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748595.109793:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788748595.485825:0:19504:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788748595.485829:0:19504:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788748595.485830:0:19504:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788748595.485956:0:19504:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8adc8256d800 00000020:01000004:1.0:1788748595.485971:0:19504:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788748595.485985:0:19504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788748595.485998:0:19504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8add885b99c0) 00000020:00000080:1.0:1788748595.486015:0:19504:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000040:00080000:0.0:1788748595.492938:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:0.0:1788748595.559665:0:19504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788748595.561421:0:19504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788748595.561745:0:19504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788748595.562062:0:19504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788748595.562239:0:19504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788748595.562719:0:19504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788748595.566370:0:19504:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788748595.568756:0:19504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788748595.570418:0:19504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788748595.570435:0:19504:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788748595.570449:0:19504:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9ba0f20a02e1b345 00000020:01000004:1.0:1788748595.570456:0:19504:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788748595.570544:0:19504:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788748595.570548:0:19504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788748595.570554:0:19504:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788748595.570584:0:19504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788748595.570588:0:19504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788748595.589813:0:19504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788748595.589982:0:19504:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788748595.589987:0:19504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788748595.589988:0:19504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748595.589989:0:19504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748595.589990:0:19504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748595.589991:0:19504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748595.589992:0:19504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748595.589994:0:19504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748595.589995:0:19504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748595.589996:0:19504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788748595.589999:0:19504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788748595.590001:0:19504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788748595.590002:0:19504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748595.590003:0:19504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748595.590004:0:19504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748595.590005:0:19504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748595.590006:0:19504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748595.590007:0:19504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748595.590008:0:19504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748595.590009:0:19504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788748595.590034:0:19504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788748595.590052:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388708864:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788748595.590122:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748595.590173:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc841459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748595.590241:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708864 00000100:00100000:3.0:1788748595.590249:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708864 00000100:00100000:3.0:1788748595.590359:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788748595.590370:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:19504:x1875638388708864:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788748595.590403:0:17180:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788748595.590407:0:17180:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788748595.590410:0:17180:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788748595.590839:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:19504:x1875638388708864:12345-0@lo:253:mount.lustre.0 Request processed in 470us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748595.590858:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788748595.590944:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388708864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788748595.590956:0:19504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788748595.590959:0:19504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788748595.590960:0:19504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788748595.590961:0:19504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788748595.590963:0:19504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788748595.590964:0:19504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788748595.590965:0:19504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788748595.590966:0:19504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788748595.590968:0:19504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788748595.590969:0:19504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788748595.590989:0:19504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8adc8256d800 from lustre-OST0001 10000000:01000000:2.0:1788748595.591017:0:19504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788748595.591020:0:19504:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788748595.591029:0:19504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8adc840f99c0 local copy 00010000:00010000:2.0:1788748595.591039:0:19504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748595.591134:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388708992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748595.591176:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.591872:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748595.592167:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388708992 00000100:00100000:0.0:1788748595.592176:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388708992 00000100:00100000:0.0:1788748595.592217:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788748595.592226:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:19504:x1875638388708992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748595.592350:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:19504:x1875638388708992:12345-0@lo:501:mount.lustre.0 Request processed in 125us (1174us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748595.592370:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788748595.592506:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388708992:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788748595.592525:0:19504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788748595.592546:0:19504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788748595.592554:0:19504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.592566:0:19504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d77000/0x9ba0f20a02e1b05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b066 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748595.592595:0:19504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8adc8256d800 10000000:01000000:2.0:1788748595.592600:0:19504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788748595.592605:0:19504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788748595.592607:0:19504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788748595.592612:0:19504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788748595.592614:0:19504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788748595.592642:0:19504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.592649:0:19504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.592659:0:19504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748595.592675:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748595.592705:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.592735:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748595.593009:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388709120 00000100:00100000:0.0:1788748595.593015:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388709120 00000100:00100000:0.0:1788748595.593039:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788748595.593046:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:19504:x1875638388709120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788748595.593055:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748595.593067:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1b353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b34c expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.593087:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1b353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b34c expref: 22 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.593096:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941200/0x9ba0f20a02e1b353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b34c expref: 22 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.593105:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941200, rc 0) 00000100:00100000:0.0:1788748595.593147:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709120:12345-0@lo:101:mount.lustre.0 Request processed in 101us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748595.593153:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788748595.593226:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748595.593246:0:19504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b34c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b353 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.593256:0:19504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b34c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b353 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748595.594392:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788748595.596067:0:19504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748595.599400:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788748595.599456:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788748595.599571:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788748595.599593:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788748595.599607:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788748595.599620:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788748595.599658:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788748595.599665:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788748595.599773:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84938a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748595.599925:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.600065:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84279d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748595.600236:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388709248 00000100:00100000:1.0:1788748595.600244:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388709248 00000100:00100000:0.0:1788748595.600389:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788748595.600400:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788748595.600563:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709248:12345-0@lo:501:mount.lustre.0 Request processed in 165us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748595.600573:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788748595.600761:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84938a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748595.600824:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788748595.600946:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748595.600980:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25600 going to sleep for 11 seconds 00000100:00100000:0.0:1788748595.601035:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388709376 00000100:00100000:0.0:1788748595.601040:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388709376 00000100:00100000:0.0:1788748595.601112:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788748595.601128:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788748595.601797:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709376:12345-0@lo:503:mount.lustre.0 Request processed in 669us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748595.601806:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788748595.601901:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788748595.602346:0:19504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788748595.602443:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748595.602506:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748595.603090:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25600 going to sleep for 11 seconds 00000100:00100000:2.0:1788748595.603146:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388709504 00000100:00100000:2.0:1788748595.603154:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388709504 00000100:00100000:3.0:1788748595.603268:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788748595.603278:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748595.603961:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709504:12345-0@lo:502:mount.lustre.0 Request processed in 682us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748595.603969:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788748595.604161:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748595.604581:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788748595.604614:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788748595.604628:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788748595.604641:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788748595.604654:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788748595.604668:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788748595.604682:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788748595.604695:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788748595.604707:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788748595.604742:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748595.604811:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748595.604977:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c25600 going to sleep for 11 seconds 00000100:00100000:3.0:1788748595.605021:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388709632 00000100:00100000:3.0:1788748595.605027:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388709632 00000100:00100000:3.0:1788748595.605106:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788748595.605114:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748595.605213:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709632:12345-0@lo:502:mount.lustre.0 Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748595.605221:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788748595.605287:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788748595.605357:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788748595.605366:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788748595.606128:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788748595.606138:0:19508:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788748595.606149:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788748595.606152:0:19508:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788748595.606158:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788748595.606173:0:19508:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8add885bb380) 00000020:00000080:1.0:1788748595.606196:0:19508:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788748595.606202:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788748595.606281:0:19508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc8256d800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788748595.606289:0:19508:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788748595.606296:0:19508:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9ba0f20a02e1b361 00010000:00010000:1.0:1788748595.610546:0:19508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788748595.611003:0:19508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788748595.612547:0:19508:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788748595.613981:0:19508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788748595.613994:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748595.614000:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.614003:0:19508:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788748595.614007:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748595.614011:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.614012:0:19508:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788748595.614016:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788748595.614018:0:19508:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788748595.614020:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748595.614022:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.614023:0:19508:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788748595.614033:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748595.614036:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.614038:0:19508:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788748595.614041:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788748595.614065:0:19508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748595.614068:0:19508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.614070:0:19508:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788748595.614073:0:19508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788748595.614219:0:19504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788748595.614249:0:19504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788748595.614301:0:19504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b353 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.614339:0:19504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add912bd400/0x9ba0f20a02e1b34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b353 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748595.614349:0:19504:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc8256d800 from 1 10000000:01000000:2.0:1788748595.614351:0:19504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748595.614386:0:19504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.614394:0:19504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.614405:0:19504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748595.614428:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788748595.614512:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.614556:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748595.614630:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388709760 00000100:00100000:1.0:1788748595.614637:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388709760 00000100:00100000:1.0:1788748595.614689:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788748595.614698:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388709760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748595.614712:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748595.614724:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b368 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.614746:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.614756:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.614765:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69000, rc 0) 00000100:00100000:1.0:1788748595.614817:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388709760:12345-0@lo:101:mount.lustre.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.614824:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788748595.615040:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788748595.615056:0:19504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748595.615064:0:19504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748595.621093:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788748595.621404:0:19504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788748595.621587:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788748595.621611:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788748595.621630:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788748595.621636:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788748595.621708:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748595.621773:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.621828:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477000 going to sleep for 11 seconds 00000100:00100000:1.0:1788748595.621961:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388709888 00000100:00100000:1.0:1788748595.621968:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388709888 00000100:00100000:1.0:1788748595.622018:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788748595.622027:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388709888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788748595.622130:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388709888:12345-0@lo:501:mount.lustre.0 Request processed in 104us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.622138:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788748595.622351:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388709888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748595.622384:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748595.622424:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.622449:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710016 00000100:00100000:2.0:1788748595.622453:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710016 00000100:00100000:2.0:1788748595.622542:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788748595.622551:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388710016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748595.622624:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388710016:12345-0@lo:503:mount.lustre.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.622640:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788748595.622678:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748595.622689:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788748595.623211:0:19504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748595.623274:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748595.625084:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.625202:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748595.628467:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710144 00000100:00100000:1.0:1788748595.629658:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710144 00000100:00100000:1.0:1788748595.629721:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788748595.629731:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388710144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748595.629987:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388710144:12345-0@lo:502:mount.lustre.0 Request processed in 248us (6662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.629995:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788748595.630115:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748595.630408:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788748595.630439:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788748595.630456:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788748595.630483:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788748595.630502:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788748595.630517:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788748595.630534:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788748595.630547:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788748595.630561:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788748595.630575:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788748595.630589:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788748595.630623:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748595.630666:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.630704:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84279e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748595.632600:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710272 00000100:00100000:1.0:1788748595.632612:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710272 00000100:00100000:1.0:1788748595.632666:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788748595.632676:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388710272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788748595.632831:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388710272:12345-0@lo:502:mount.lustre.0 Request processed in 156us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.632839:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788748595.633149:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788748595.633227:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788748595.633240:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788748595.639220:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748595.639235:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639237:0:19512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788748595.639245:0:19512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc8256d800 00000020:00000080:3.0:1788748595.639248:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748595.639269:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748595.639272:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639273:0:19512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788748595.639276:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748595.639279:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639280:0:19512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788748595.639284:0:19512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8adc8256d800 00000020:00000080:3.0:1788748595.639286:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748595.639369:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748595.639373:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639374:0:19512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788748595.639377:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748595.639380:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639381:0:19512:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788748595.639385:0:19512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc8256d800 00000020:00000080:3.0:1788748595.639387:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748595.639406:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748595.639408:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639410:0:19512:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788748595.639412:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788748595.639414:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639415:0:19512:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788748595.639419:0:19512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8adc8256d800 00000020:00000080:3.0:1788748595.639421:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788748595.639443:0:19512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788748595.639446:0:19512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788748595.639447:0:19512:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788748595.639450:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788748595.645064:0:19504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788748595.645105:0:19504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788748595.645122:0:19504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748595.645145:0:19504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788748595.645208:0:19504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788748595.645211:0:19504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8adc8256d800 10000000:01000000:3.0:1788748595.645214:0:19504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8adc8256d800 10000000:01000000:3.0:1788748595.645218:0:19504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788748595.645223:0:19504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8adc8256d800 from 1 10000000:01000000:3.0:1788748595.645226:0:19504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788748595.645259:0:19504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1b376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748595.645269:0:19504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1b376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748595.645279:0:19504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1b376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748595.645305:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788748595.645415:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.645459:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84279a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788748595.648372:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710400 00000100:00100000:1.0:1788748595.648385:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710400 00000100:00100000:1.0:1788748595.648442:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788748595.648452:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:19504:x1875638388710400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788748595.648523:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748595.648543:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a68e00/0x9ba0f20a02e1b37d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b376 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.648580:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a68e00/0x9ba0f20a02e1b37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b376 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.648591:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a68e00/0x9ba0f20a02e1b37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b376 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.648599:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68e00, rc 0) 00000100:00100000:1.0:1788748595.648668:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710400:12345-0@lo:101:mount.lustre.0 Request processed in 218us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.648675:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788748595.648965:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788748595.648982:0:19504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1b376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b37d expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748595.648992:0:19504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1b376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b37d expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788748595.653181:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788748595.653755:0:19504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788748595.654169:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788748595.654198:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788748595.654211:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788748595.654223:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788748595.654235:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788748595.654247:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788748595.654258:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788748595.654269:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788748595.654282:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788748595.654295:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788748595.654309:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788748595.654356:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788748595.654386:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788748595.654403:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788748595.654414:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788748595.654428:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788748595.654440:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788748595.654452:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788748595.654463:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788748595.655679:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788748595.655713:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788748595.655724:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788748595.655735:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788748595.655747:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788748595.655757:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788748595.655767:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788748595.655778:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788748595.655804:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788748595.655830:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788748595.656705:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788748595.656731:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788748595.656743:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788748595.656754:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788748595.656765:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788748595.656775:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788748595.656798:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788748595.656809:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788748595.656820:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788748595.656830:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788748595.656841:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788748595.658065:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788748595.658088:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788748595.658099:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788748595.658111:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788748595.658124:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788748595.658148:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788748595.658173:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788748595.658179:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788748595.658278:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788748595.658358:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.658399:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84279e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748595.659122:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710528 00000100:00100000:2.0:1788748595.659131:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710528 00000100:00100000:2.0:1788748595.659179:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788748595.659188:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748595.659340:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710528:12345-0@lo:501:mount.lustre.0 Request processed in 152us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.659347:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788748595.661635:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788748595.661699:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748595.661768:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.661826:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add81658300 going to sleep for 11 seconds 00000100:00100000:2.0:1788748595.663613:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710656 00000100:00100000:2.0:1788748595.663625:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710656 00000100:00100000:2.0:1788748595.663678:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788748595.663687:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788748595.663837:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710656:12345-0@lo:503:mount.lustre.0 Request processed in 150us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.666591:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788748595.666671:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710656:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788748595.670661:0:19504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788748595.670754:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748595.670840:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.671558:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91338b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748595.671962:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710784 00000100:00100000:3.0:1788748595.671971:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710784 00000100:00100000:3.0:1788748595.672040:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788748595.672050:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748595.672198:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710784:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748595.672218:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788748595.672688:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748595.673045:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788748595.673078:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788748595.673095:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788748595.673110:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788748595.673125:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788748595.673140:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788748595.673153:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788748595.673166:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788748595.673179:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788748595.673206:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788748595.673223:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788748595.673236:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788748595.673249:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788748595.673261:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788748595.673272:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788748595.673282:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788748595.673292:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788748595.673303:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788748595.673347:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788748595.673364:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788748595.673375:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788748595.673398:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788748595.673410:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788748595.673423:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788748595.673436:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788748595.673462:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788748595.674659:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788748595.674692:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788748595.674707:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788748595.674722:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788748595.674737:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788748595.674751:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788748595.674766:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788748595.674791:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788748595.674810:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788748595.674824:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788748595.674837:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788748595.675440:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788748595.675467:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788748595.675936:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788748595.675952:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788748595.675990:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788748595.676006:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788748595.676019:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788748595.676032:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788748595.676043:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788748595.676055:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788748595.676068:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788748595.676122:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748595.676194:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.676685:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388710912 00000100:00100000:2.0:1788748595.676707:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91338b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748595.676789:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388710912 00000100:00100000:3.0:1788748595.676842:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788748595.676852:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748595.676970:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388710912:12345-0@lo:502:mount.lustre.0 Request processed in 119us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748595.676978:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788748595.677064:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388710912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748595.677250:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788748595.677273:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788748595.677296:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388711040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788748595.677369:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.677400:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91338b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748595.677612:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711040 00000100:00100000:3.0:1788748595.677617:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711040 00000100:00100000:3.0:1788748595.677648:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788748595.677654:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388711040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788748595.677725:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388711040:12345-0@lo:502:mount.lustre.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748595.677732:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788748595.678958:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388711040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788748595.679072:0:19504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788748595.679084:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788748595.681912:0:19517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788748595.681931:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8adc825d4d40) 00000020:00000080:2.0:1788748595.681954:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788748595.683261:0:19517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc8256d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788748595.683268:0:19517:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc8256d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788748595.683271:0:19517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc8256d800 3 00010000:00080000:2.0:1788748595.683303:0:19517:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8adc82f6a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788748595.687458:0:19517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788748595.687723:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788748595.687767:0:19517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788748595.687792:0:19517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9ba0f20a02e1b38b 00000100:00080000:2.0:1788748595.687802:0:19517:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748595.687813:0:19517:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8adc82f6a800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748595.687858:0:19517:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc840bbb80 x1875638388711168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788748595.687887:0:19517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788748595.687928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748595.687932:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748595.687941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748595.687943:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748595.688003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748595.688006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788748595.688009:0:36:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788748595.688014:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:2.0:1788748595.688018:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788748595.688023:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8add842b8800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748595.688037:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc840bb800 x1875638388711808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748595.688080:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388711168:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788748595.688144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.688457:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388711296:0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.688492:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.688522:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388711680:0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.688548:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.688574:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388711808:0@lo:8:kworker.0 00000100:00100000:2.0:1788748595.688592:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388711424:0@lo:400:kworker.0 00000100:00100000:3.0:1788748595.688607:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.688629:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.688650:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711680 00000100:00100000:2.0:1788748595.688655:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388712064:0@lo:400:kworker.0 00000100:00100000:3.0:1788748595.688658:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711680 00000100:00100000:2.0:1788748595.688682:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.688707:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788748595.688715:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388711552:0@lo:400:kworker.0 00000100:00100000:3.0:1788748595.688716:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711808 00000100:00100000:3.0:1788748595.688722:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711808 00000100:00100000:2.0:1788748595.688748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.688749:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748595.688762:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388711680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.688772:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388712192:0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.688810:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.688831:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388711680:12345-0@lo:400:kworker.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748595.688839:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788748595.688858:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748595.688863:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711168 00000100:00100000:2.0:1788748595.688870:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711168 00000100:00100000:3.0:1788748595.688874:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875638388711808:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788748595.688888:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711424 00000100:00100000:2.0:1788748595.688892:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711424 00000100:00100000:2.0:1788748595.688925:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712064 00000100:00100000:2.0:1788748595.688929:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712064 00000100:00100000:2.0:1788748595.688943:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712192 00000100:00100000:2.0:1788748595.688946:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712192 00000100:00100000:2.0:1788748595.688960:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748595.688966:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388711424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748595.689115:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875638388711808:12345-0@lo:8:kworker.0 Request processed in 240us (507us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788748595.689122:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788748595.689138:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788748595.689141:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748595.689144:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748595.689169:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788748595.689176:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788748595.689179:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788748595.689182:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388711808:0@lo:8:kworker.0 00000100:00100000:2.0:1788748595.689294:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388711424:12345-0@lo:400:kworker.0 Request processed in 327us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.689301:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788748595.689337:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748595.689344:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388712064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.689376:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875638388712064:12345-0@lo:400:kworker.0 Request processed in 33us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.689382:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788748595.689394:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748595.689400:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388712192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.689426:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388712192:12345-0@lo:400:kworker.0 Request processed in 26us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.689432:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788748595.689445:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748595.689449:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875638388711168:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788748595.689465:0:18714:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:2.0:1788748595.689505:0:18714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9ba0f20a02e1b392 00000004:00100000:2.0:1788748595.689526:0:18714:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788748595.689554:0:18714:0:(import.c:65:import_set_state_nolock()) ffff8addbc785000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748595.689594:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875638388711168:12345-0@lo:38:llog_process_th.0 Request processed in 143us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.689601:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748595.689644:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711296 00000100:00100000:2.0:1788748595.689648:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711296 00000100:00100000:2.0:1788748595.689670:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711552 00000100:00100000:2.0:1788748595.689673:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711552 00000100:00100000:2.0:1788748595.689685:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788748595.689690:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388711296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.689722:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388711296:12345-0@lo:400:kworker.0 Request processed in 32us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.689727:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788748595.689738:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788748595.689743:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388711552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.689792:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388711552:12345-0@lo:400:kworker.0 Request processed in 36us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.689799:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788748595.690047:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388711296:0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.690057:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388711936:0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.690087:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788748595.690137:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840bb480 x1875638388711680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788748611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748595.690147:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388711680:0@lo:400:kworker.0 00010000:00080000:2.0:1788748595.690175:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840bbb80 x1875638388711168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748595.690189:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748595.690196:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788748595.690202:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788748595.690206:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788748595.690208:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8adc82f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748595.690214:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875638388711168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788748595.690231:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388711936 00000100:00100000:2.0:1788748595.690235:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388711936 00000100:00100000:2.0:1788748595.690257:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788748595.690263:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388711936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748595.690298:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875638388711936:12345-0@lo:400:kworker.0 Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.690304:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788748595.690368:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840ba680 x1875638388711936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748595.690378:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875638388711936:0@lo:400:kworker.0 00000100:00100000:3.0:1788748595.690586:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388711552:0@lo:400:kworker.0 00010000:00080000:3.0:1788748595.690598:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840bb100 x1875638388712192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748595.690607:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388712192:0@lo:400:kworker.0 00010000:00080000:3.0:1788748595.690617:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840baa00 x1875638388711424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748595.690626:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388711424:0@lo:400:kworker.0 00010000:00080000:3.0:1788748595.690636:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc840b8a80 x1875638388712064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748595.690643:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875638388712064:0@lo:400:kworker.0 00000020:01000004:2.0:1788748595.692753:0:19517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788748595.692772:0:19517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8add9ea64d40) 00000020:00000080:2.0:1788748595.692807:0:19517:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788748595.693736:0:19517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8adc8256d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788748595.693742:0:19517:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8adc8256d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788748595.693745:0:19517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8adc8256d800 3 00010000:00080000:2.0:1788748595.693777:0:19517:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8add8595b000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788748595.698010:0:19517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788748595.698216:0:19517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788748595.698267:0:19517:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788748595.698280:0:19517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9ba0f20a02e1b3a0 00000100:00080000:2.0:1788748595.698291:0:19517:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788748595.698301:0:19517:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8add8595b000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788748595.698362:0:19517:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc843f0e00 x1875638388712320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788748595.698399:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875638388712320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788748595.698466:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748595.698607:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712320 00000100:00100000:2.0:1788748595.698614:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712320 00000100:00100000:2.0:1788748595.698646:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748595.698653:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875638388712320:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788748595.698678:0:17184:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:2.0:1788748595.698708:0:17184:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9ba0f20a02e1b3a7 00000004:00100000:2.0:1788748595.698722:0:17184:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788748595.698766:0:17184:0:(import.c:65:import_set_state_nolock()) ffff8adc83ebe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748595.700485:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875638388712320:12345-0@lo:38:llog_process_th.0 Request processed in 1825us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748595.700499:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788748595.700565:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8adc843f0e00 x1875638388712320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788748605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748595.700577:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788748595.700585:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788748595.700593:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788748595.700598:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788748595.700601:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add8595b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788748595.700615:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875638388712320:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788748595.700639:0:19517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788748595.700661:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748595.700665:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788748595.700668:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788748595.700671:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788748595.704144:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788748595.705493:0:19504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788748595.705531:0:19504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788748595.705547:0:19504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1b376 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b37d expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748595.705566:0:19504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8add95d76000/0x9ba0f20a02e1b376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b37d expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788748595.705624:0:19504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788748595.705627:0:19504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788748595.705628:0:19504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748595.705630:0:19504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748595.705631:0:19504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748595.705633:0:19504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748595.705634:0:19504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748595.705636:0:19504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748595.705637:0:19504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748595.705641:0:19504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788748595.705644:0:19504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788748595.705645:0:19504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788748595.705646:0:19504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788748595.705648:0:19504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788748595.705649:0:19504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788748595.705650:0:19504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788748595.705652:0:19504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788748595.705653:0:19504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788748595.705654:0:19504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788748595.706139:0:19504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788748595.706162:0:19504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388712448:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788748595.706236:0:19504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748595.706295:0:19504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc84279240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748595.709431:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712448 00000100:00100000:3.0:1788748595.709447:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712448 00000100:00100000:3.0:1788748595.709510:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788748595.709520:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:19504:x1875638388712448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788748595.709552:0:17180:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788748595.709566:0:17180:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788748595.714425:0:17180:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788748595.714441:0:17180:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788748595.714561:0:17201:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788748595.714567:0:17201:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788748595.714588:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.714607:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.714615:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.714622:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.714661:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.714674:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 24 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748595.714688:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388712576:0@lo:104: 00000100:00100000:0.0:1788748595.714763:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748595.714825:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.714833:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 24 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748595.714862:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388712704:0@lo:104: 00000100:00100000:0.0:1788748595.714884:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748595.714901:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748595.715051:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712576 00000100:00100000:1.0:1788748595.715058:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712576 00000100:00100000:1.0:1788748595.715094:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712704 00000100:00100000:1.0:1788748595.715096:0:17168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712704 00000100:00100000:1.0:1788748595.715107:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748595.715116:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:17201:x1875638388712576:12345-0@lo:104: 00010000:00010000:1.0:1788748595.715127:0:17168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715186:0:17168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748595.715192:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:17201:x1875638388712576:12345-0@lo:104: Request processed in 78us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.715199:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748595.715217:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748595.715223:0:17168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388712704:12345-0@lo:104: 00010000:00010000:1.0:1788748595.715251:0:17168:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715286:0:17168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748595.715292:0:17168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:17201:x1875638388712704:12345-0@lo:104: Request processed in 70us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.715298:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788748595.715338:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748595.715343:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715350:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940000 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748595.715353:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715361:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748595.715368:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748595.715373:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748595.715397:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715403:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748595.715421:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715428:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940000/0x9ba0f20a02e1b329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b330 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715446:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748595.715450:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715455:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748595.715458:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715465:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748595.715471:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748595.715476:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788748595.715489:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715496:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748595.715503:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715509:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b31b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b322 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715520:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748595.715521:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748595.715523:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748595.715529:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748595.715546:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388712832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748595.715573:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748595.715592:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748595.715597:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388712960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748595.715614:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748595.715639:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712832 00000100:00100000:1.0:1788748595.715643:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712832 00010000:00010000:1.0:1788748595.715660:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 25 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748595.715679:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388712960 00000100:00100000:1.0:1788748595.715682:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388712960 00010000:00010000:1.0:1788748595.715691:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 26 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748595.715703:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748595.715709:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+26:3637:x1875638388712832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748595.715718:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748595.715722:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 26 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715744:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 26 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715760:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748595.715798:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+26:3637:x1875638388712832:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.715804:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748595.715818:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748595.715825:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+25:3637:x1875638388712960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748595.715840:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748595.715854:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 25 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715864:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 25 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715876:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715883:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788748595.715896:0:17171:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010187036s 00010000:00010000:1.0:1788748595.715900:0:17171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715907:0:17171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715914:0:17171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715921:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715926:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748595.715931:0:17171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715938:0:17171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715953:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748595.715963:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748595.715987:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+25:3637:x1875638388712960:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.715992:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748595.716032:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388712960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748595.716040:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388712832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788748595.716449:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bc600/0x9ba0f20a02e1b330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b329 expref: 24 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748595.716462:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388712576:0@lo:104: 00010000:00010000:0.0:1788748595.716482:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bce00/0x9ba0f20a02e1b322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b31b expref: 23 pid: 17177 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748595.716490:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17201:1875638388712704:0@lo:104: 00010000:00010000:0.0:1788748595.716509:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.716518:0:17201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.716524:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748595.716530:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b3ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748595.716712:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83854050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:19504:x1875638388712448:12345-0@lo:253:mount.lustre.0 Request processed in 7193us (10475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748595.716722:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788748595.716875:0:19504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f35c4edf-1df7-4d0c-8881-06ee23716a92:19504:1875638388712448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788748595.716887:0:19504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788748595.716891:0:19504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788748595.716893:0:19504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788748595.716901:0:19504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788748595.716902:0:19504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788748595.716903:0:19504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788748595.716904:0:19504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788748595.716906:0:19504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788748595.716907:0:19504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788748595.716909:0:19504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788748595.716920:0:19504:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788748595.738040:0:19504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788748595.745006:0:19504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788748595.745015:0:19504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788748595.745051:0:19504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788748595.745089:0:19504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788748595.745112:0:19504:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788748595.745135:0:19504:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788748595.749924:0:19504:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748595.750136:0:19504:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748596.132771:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788748596.607206:0:19572:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788748596.607533:0:19572:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748597.156596:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788748597.156691:0:17182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788748597.156696:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8add913f3000 from 10 10000000:01000000:0.0:1788748597.156701:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788748597.156740:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b3b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748597.156751:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b3b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748597.156762:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b3b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748597.156796:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8380ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748597.156861:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748597.156907:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add88908240 going to sleep for 11 seconds 00000100:00100000:3.0:1788748597.157076:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713088 00000100:00100000:3.0:1788748597.157084:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713088 00000100:00100000:3.0:1788748597.157138:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788748597.157149:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:17182:x1875638388713088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748597.157162:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748597.157175:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1b3bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b3b5 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748597.157198:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1b3bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b3b5 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748597.157208:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77800/0x9ba0f20a02e1b3bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b3b5 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748597.157218:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77800, rc 0) 00000100:00100000:3.0:1788748597.157335:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388713088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748597.157342:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788748597.162401:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8380ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748597.162429:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b3b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b3bc expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748597.162444:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b3b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b3bc expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748597.162529:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788748597.162591:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748597.162642:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c2ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748597.162847:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713216 00000100:00100000:3.0:1788748597.162854:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713216 00000100:00100000:3.0:1788748597.162896:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788748597.162906:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388713216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788748597.162926:0:17180:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748597.162942:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748597.162945:0:17180:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788748597.163027:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388713216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748597.163036:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788748597.163170:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788748597.163226:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788748597.163234:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b3b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b3bc expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748597.163244:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941600/0x9ba0f20a02e1b3b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b3bc expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748597.163254:0:17182:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788748597.163256:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8adc848d0800 from 10 10000000:01000000:1.0:1788748597.163259:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788748597.163282:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b3c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748597.163290:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b3c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748597.163299:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b3c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748597.163312:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748597.163371:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748597.163402:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add84c2ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788748597.163553:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713344 00000100:00100000:3.0:1788748597.163564:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713344 00000100:00100000:3.0:1788748597.163596:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788748597.163603:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388713344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748597.163613:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748597.163624:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1b3ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b3c3 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748597.163644:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1b3ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b3c3 expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748597.163653:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8add95d77e00/0x9ba0f20a02e1b3ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b3c3 expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748597.163661:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add95d77e00, rc 0) 00000100:00100000:3.0:1788748597.163702:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388713344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748597.163708:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788748597.163792:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748597.163804:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b3c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b3ca expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748597.163813:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b3c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b3ca expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748597.163858:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788748597.163888:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748597.163919:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add91338cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748597.164566:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713472 00000100:00100000:3.0:1788748597.164573:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713472 00000100:00100000:3.0:1788748597.164616:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788748597.164625:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388713472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788748597.164645:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788748597.164661:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788748597.164664:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788748597.164750:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83855450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388713472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748597.164757:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788748597.164816:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388713472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788748597.164872:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788748597.164880:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b3c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b3ca expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748597.164889:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a68200/0x9ba0f20a02e1b3c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b3ca expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748598.052638:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748598.052661:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388713600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748598.052728:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748598.053376:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713600 00000100:00100000:2.0:1788748598.053385:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713600 00000100:00100000:2.0:1788748598.053454:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788748598.053473:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388713600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748598.053508:0:17926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788748598.053565:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388713600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748598.053573:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788748598.053860:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388713600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748598.053999:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388713728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748598.054109:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748598.054187:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713728 00000100:00100000:2.0:1788748598.054193:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713728 00000100:00100000:2.0:1788748598.054304:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788748598.054312:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388713728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748598.054354:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788748598.054393:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388713728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748598.054400:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788748598.054431:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388713728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788748598.058800:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748598.058822:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388713856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788748598.058890:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748598.059097:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713856 00000100:00100000:2.0:1788748598.059106:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713856 00000100:00100000:2.0:1788748598.059168:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748598.059177:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388713856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788748598.059203:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788748598.059265:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388713856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748598.059274:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788748598.059280:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788748598.059345:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc843f3480 x1875638388713856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748598.059364:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388713856:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788748598.188162:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748598.756408:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748578/real 1788748578] req@ffff8adc8407ca80 x1875638388699904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748598 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748598.756438:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc8407ca80 x1875638388699904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748598 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748598.756448:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788748578/real 1788748578] req@ffff8adc8407ea00 x1875638388700032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748598 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748598.756458:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8adc8407ea00 x1875638388700032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788748598 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788748598.756476:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addae418000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748598.756488:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788748598.756493:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388699904:0@lo:8:kworker.0 00000100:00080000:2.0:1788748598.756498:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add83fbb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788748598.756502:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788748598.756505:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388700032:0@lo:8:kworker.0 00000100:00100000:2.0:1788748598.756656:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388713984:0@lo:400:kworker.0 00000100:00100000:2.0:1788748598.756718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788748598.756799:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748598.756804:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788748598.756807:0:36:0:(import.c:65:import_set_state_nolock()) ffff8addae418000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748598.756812:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788748598.756816:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788748598.756835:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8addae418000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748598.756857:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842f9c00 x1875638388714112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748598.756872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748598.756875:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788748598.756877:0:36:0:(import.c:65:import_set_state_nolock()) ffff8add83fbb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748598.756881:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788748598.756883:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788748598.756887:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8add83fbb000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748598.756899:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842f8e00 x1875638388714240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788748598.756925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788748598.756928:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788748598.756930:0:36:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788748598.756935:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8add842b8800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788748598.756946:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8adc842fb100 x1875638388714496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788748598.757016:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388713984 00000100:00100000:3.0:1788748598.757025:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388713984 00000100:00100000:3.0:1788748598.757067:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788748598.757076:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3638:x1875638388713984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.757529:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388714752:0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.757567:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.757591:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748598.757597:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388714880:0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.757615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.757638:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388714368:0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.757659:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.757675:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388715008:0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.757697:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.757713:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788748598.757718:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388714624:0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.757737:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.757747:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388715136:0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.757781:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.757946:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388714752 00000100:00100000:1.0:1788748598.757952:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388714752 00000100:00100000:1.0:1788748598.757989:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388714880 00000100:00100000:1.0:1788748598.757993:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388714880 00000100:00100000:1.0:1788748598.758006:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388714368 00000100:00100000:1.0:1788748598.758009:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388714368 00000100:00100000:1.0:1788748598.758020:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715008 00000100:00100000:1.0:1788748598.758021:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715008 00000100:00100000:1.0:1788748598.758031:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388714624 00000100:00100000:1.0:1788748598.758034:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388714624 00000100:00100000:1.0:1788748598.758042:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715136 00000100:00100000:1.0:1788748598.758045:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715136 00000100:00100000:1.0:1788748598.758058:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748598.758065:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388714752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.758108:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875638388714752:12345-0@lo:400:kworker.0 Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.758121:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788748598.758140:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748598.758146:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388714880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.758175:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388714880:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.758180:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788748598.758192:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788748598.758198:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388714368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.758346:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388714368:12345-0@lo:400:kworker.0 Request processed in 148us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.758352:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788748598.758366:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788748598.758372:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388715008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.758400:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388715008:12345-0@lo:400:kworker.0 Request processed in 29us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.758406:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788748598.758418:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788748598.758423:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388714624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.758449:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388714624:12345-0@lo:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.758454:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788748598.758464:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788748598.758470:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388715136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.758494:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388715136:12345-0@lo:400:kworker.0 Request processed in 25us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.758508:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788748598.758530:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748598.758534:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788748598.758556:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842f8000 x1875638388714880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.758569:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388714880:0@lo:400:kworker.0 00010000:00080000:1.0:1788748598.758579:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842f9500 x1875638388714752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.758586:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875638388714752:0@lo:400:kworker.0 00000100:00100000:1.0:1788748598.758607:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388714112:0@lo:8:kworker.0 00000100:00100000:1.0:1788748598.758632:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.758666:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388714240:0@lo:8:kworker.0 00000100:00100000:1.0:1788748598.758685:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.758701:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388714496:0@lo:8:kworker.0 00000100:00100000:1.0:1788748598.758725:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.758755:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388714112 00000100:00100000:1.0:1788748598.758770:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388714112 00000100:00100000:1.0:1788748598.758790:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388714240 00000100:00100000:1.0:1788748598.758793:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388714240 00000100:00100000:1.0:1788748598.758801:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388714496 00000100:00100000:1.0:1788748598.758803:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388714496 00000100:00100000:1.0:1788748598.758811:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748598.758815:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875638388714112:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788748598.759091:0:18693:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:1.0:1788748598.759118:0:18693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e1b3d1 00002000:00100000:1.0:1788748598.759138:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8adc8414a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788748598.759143:0:18693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788748598.759145:0:18693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788748598.759228:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788748598.759250:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8adc8414b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748598.759294:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875638388714112:12345-0@lo:8:kworker.0 Request processed in 477us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.759300:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788748598.759335:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748598.759340:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875638388714240:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788748598.759355:0:18693:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:1.0:1788748598.759370:0:18693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9ba0f20a02e1b3d8 00002000:00100000:1.0:1788748598.759376:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8adc8414d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788748598.759379:0:18693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788748598.759381:0:18693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788748598.759503:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788748598.759517:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8adc8414d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748598.759545:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875638388714240:12345-0@lo:8:kworker.0 Request processed in 204us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.759551:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788748598.759565:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788748598.759569:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875638388714496:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788748598.759583:0:18693:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:1.0:1788748598.759598:0:18693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9ba0f20a02e1b3df 00002000:00100000:1.0:1788748598.759604:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8adc84148000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788748598.759615:0:18693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788748598.759616:0:18693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788748598.759638:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788748598.759651:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8adc8414f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748598.759678:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3634:x1875638388714496:12345-0@lo:8:kworker.0 Request processed in 108us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.759684:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788748598.759726:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842f9f80 x1875638388714624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.759738:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388714624:0@lo:400:kworker.0 00010000:00080000:1.0:1788748598.759749:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbce00 x1875638388715136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.759756:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388715136:0@lo:400:kworker.0 00010000:00080000:1.0:1788748598.759780:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842fa300 x1875638388714368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.759787:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388714368:0@lo:400:kworker.0 00010000:00080000:1.0:1788748598.759797:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbca80 x1875638388715008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.759804:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388715008:0@lo:400:kworker.0 00000100:00100000:3.0:1788748598.760076:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3638:x1875638388713984:12345-0@lo:400:kworker.0 Request processed in 2998us (3356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748598.760085:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788748598.760395:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842f9c00 x1875638388714112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.760404:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748598.760411:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788748598.760425:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788748598.760430:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788748598.760433:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8addae418000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788748598.760492:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788748598.760498:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388714112:0@lo:8:kworker.0 00000004:00080000:0.0:1788748598.760504:0:17209:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1788748598.760513:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842f8e00 x1875638388714240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.760520:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788748598.760524:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788748598.760527:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788748598.760530:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788748598.760532:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add83fbb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788748598.760548:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788748598.760551:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875638388714240:0@lo:8:kworker.0 00010000:00080000:1.0:1788748598.760563:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842fb100 x1875638388714496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788748623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788748598.760569:0:17209:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 515747251450ns, next at 0ns, rc = 0 00000100:00080000:1.0:1788748598.760571:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00080000:00080000:0.0:1788748598.760574:0:17209:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1788748598.760575:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788748598.760577:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788748598.760579:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8add842b8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788748598.760589:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788748598.760592:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875638388714496:0@lo:8:kworker.0 00000004:00080000:1.0:1788748598.760639:0:17212:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788748598.760655:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17212:1875638388715392:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788748598.760688:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.760714:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748598.760735:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388715264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748598.760771:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.760806:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715264 00000100:00100000:1.0:1788748598.760813:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715264 00000100:00100000:1.0:1788748598.761022:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748598.761031:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388715264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748598.761054:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788748598.761092:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388715264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.761098:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788748598.761128:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788748598.761144:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbca80 x1875638388715264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.761158:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388715264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748598.761175:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715392 00000100:00100000:1.0:1788748598.761179:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715392 00000100:00100000:1.0:1788748598.761201:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748598.761207:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17212:x1875638388715392:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788748598.761551:0:17930:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788748598.761567:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17930:1875638388715648:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788748598.761783:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388713984:0@lo:400:kworker.0 00000100:00100000:2.0:1788748598.761817:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388715520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748598.761868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748598.761896:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715520 00000100:00100000:2.0:1788748598.761901:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715520 00000100:00100000:2.0:1788748598.761932:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788748598.761940:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875638388715520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748598.761959:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788748598.761991:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875638388715520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748598.761997:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788748598.762016:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788748598.762031:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbca80 x1875638388715520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748598.762046:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388715520:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788748598.762073:0:17929:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788748598.762141:0:17929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 515748823506ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788748598.762146:0:17929:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788748598.762441:0:17211:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788748598.762483:0:17211:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 515749165454ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788748598.762487:0:17211:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788748598.763625:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.763649:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748598.763673:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715648 00000100:00100000:1.0:1788748598.763678:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715648 00000100:00100000:1.0:1788748598.763717:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748598.763725:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17930:x1875638388715648:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788748598.765943:0:17210:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788748598.765969:0:17210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17210:1875638388715904:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788748598.766033:0:17210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748598.766068:0:18692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788748598.766075:0:18692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788748598.766088:0:17210:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add913389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748598.768755:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748598.768793:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388715776:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788748598.768816:0:17165:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788748598.768872:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1788748598.770368:0:18693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788748598.770378:0:18693:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788748598.770384:0:18693:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:0.0:1788748598.772854:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715776 00000100:00100000:0.0:1788748598.772870:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715776 00000100:00100000:0.0:1788748598.772962:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788748598.772987:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388715776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788748598.773013:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788748598.773093:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388715776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (4220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748598.773099:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788748598.773143:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc843f0a80 x1875638388715776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788748614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748598.773164:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388715776:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788748598.774586:0:17918:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:1.0:1788748598.775606:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748598.775652:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388715904 00000100:00100000:1.0:1788748598.775662:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388715904 00000100:00100000:3.0:1788748598.775855:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748598.775867:0:19687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17210:x1875638388715904:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788748598.778060:0:17165:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788748598.780201:0:19687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788748598.780216:0:19687:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788748598.780224:0:19687:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00080000:1.0:1788748598.780284:0:18690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788748598.780289:0:18690:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788748598.780399:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17930:x1875638388715648:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16671us (16772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.780409:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788748598.780468:0:17930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbdc00 x1875638388715648/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788748614 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.780482:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17930:1875638388715648:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788748598.780496:0:17930:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788748598.780537:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17930:1875638388716032:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788748598.780576:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.780598:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748598.780615:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716032 00000100:00100000:1.0:1788748598.780620:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716032 00000100:00100000:1.0:1788748598.780668:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748598.780675:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17930:x1875638388716032:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788748598.780708:0:18692:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788748598.780741:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17930:x1875638388716032:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.780746:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788748598.780785:0:17930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbdc00 x1875638388716032/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788748614 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.780809:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17930:1875638388716032:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788748598.780958:0:17930:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788748598.780986:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17930:1875638388716160:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788748598.781010:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.781061:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adda71aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748598.781687:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716160 00000100:00100000:0.0:1788748598.781800:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716160 00000100:00100000:0.0:1788748598.781957:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788748598.781967:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17930:x1875638388716160:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788748598.781999:0:18690:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1788748598.794444:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.794457:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.794484:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.794489:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.794495:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.794512:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.794522:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.794530:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.794550:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748598.794757:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748598.794774:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.794782:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bce00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.794787:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.794796:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.794816:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.794823:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f240dae/0x9ba0f20a02e1b3e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.794843:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.794845:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.794847:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.795408:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.795415:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.795425:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.795428:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.795433:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.795443:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.795474:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.795481:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.795496:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748598.795662:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748598.795668:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.795676:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc600 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.795679:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.795687:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.795699:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.795706:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c05a7dce/0x9ba0f20a02e1b3ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.795722:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.795724:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.795726:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.796942:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.796953:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.796967:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.796971:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.796976:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.796988:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.796997:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.797005:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.797040:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748598.797218:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748598.797225:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.797234:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bd200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.797237:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.797257:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.797272:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.797279:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050bf343b/0x9ba0f20a02e1b3f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.797296:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.797298:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.797299:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.798005:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.798013:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.798024:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.798027:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.798031:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.798041:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.798050:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.798057:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.798112:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748598.799892:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.799904:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.799925:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.799938:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.799944:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.799957:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.799966:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.799974:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805539:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748598.805552:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805565:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fb400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.805569:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805580:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805601:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805624:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f79bf781/0x9ba0f20a02e1b3fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805653:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748598.805656:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805663:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fa000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.805666:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805674:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805685:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.805693:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.805694:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.805696:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.809338:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788748598.809350:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.809561:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.810014:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.810023:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810036:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.810041:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.810048:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810062:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810079:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810086:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810102:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748598.810111:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.810116:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810124:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fa400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.810127:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810136:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810153:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810160:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b409 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.810175:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.810182:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.810184:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.810691:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.810699:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.810708:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.810714:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.810718:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.810731:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.810751:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.810768:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.810786:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748598.811624:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.811633:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.811645:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.811649:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.811657:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.811675:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.811682:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b410 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.811703:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.811704:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.811706:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.812391:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.812399:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.812411:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.812415:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.812420:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.812432:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.812441:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.812448:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.812600:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748598.812920:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788748598.812927:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.812934:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748598.812938:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.812952:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.812967:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.812973:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b417 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.812988:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748598.812989:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748598.812991:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.813279:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.813286:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.813296:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.813300:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.813304:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.813348:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.813358:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.813365:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.813383:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748598.813521:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748598.813527:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.813536:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.813546:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.813555:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.813568:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.813982:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b41e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.814002:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.814004:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.814006:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748598.814454:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788748598.814461:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.814471:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788748598.814475:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748598.814479:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.814489:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.814499:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.814513:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.814533:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748598.815147:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.815155:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815166:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.815176:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815186:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815201:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815210:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019f4c18a/0x9ba0f20a02e1b425 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815227:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.815229:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.815230:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748598.815310:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788748598.815340:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.815349:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788748598.815353:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748598.815357:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.815365:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.815373:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.815380:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.815397:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748598.815569:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.815932:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815941:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.815945:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815953:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815965:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815978:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009d7a5b7/0x9ba0f20a02e1b42c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.815993:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.815995:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.815996:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788748598.816079:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788748598.816085:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.816099:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788748598.816103:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748598.816107:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.816116:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.816123:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.816130:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.816175:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748598.816287:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.816295:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816303:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.816306:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816339:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816352:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816359:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064577ff3/0x9ba0f20a02e1b433 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816372:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.816373:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.816375:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.816432:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.816438:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.816446:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.816449:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.816464:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.816475:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.816483:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.816494:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.816515:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748598.816655:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.816661:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816669:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fa200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.816673:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816681:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816695:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816703:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13a8e8f/0x9ba0f20a02e1b43a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.816720:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.816722:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.816723:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.817174:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.817180:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817189:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.817192:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.817196:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817204:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817212:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817229:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817240:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748598.817530:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.817536:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817544:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.817546:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.817550:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817560:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817566:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817573:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.817585:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788748598.818549:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.818558:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.818578:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.818582:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.818586:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.818596:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.818604:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.818611:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.818622:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788748598.818958:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788748598.818966:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.818976:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fb600 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.818980:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819001:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819017:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819024:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007717fa9c/0x9ba0f20a02e1b441 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819043:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.819046:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819053:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fba00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.819056:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819063:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819073:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819081:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000831af9ff/0x9ba0f20a02e1b448 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819106:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.819109:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819116:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fb200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.819119:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819126:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819135:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819140:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b44f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.819150:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.819151:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.819153:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.820827:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.820837:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.820852:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.820857:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.820863:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.820874:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.820898:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.820905:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.820939:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748598.821824:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.821832:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.821843:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.821847:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.821852:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.821862:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.821870:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.821878:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.821900:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788748598.822409:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.822416:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.822425:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.822428:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.822444:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.822640:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.822650:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.822657:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.822666:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788748598.825294:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788748598.825875:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.825892:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fa400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.825920:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.825933:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.825953:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.825961:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebf7caf4/0x9ba0f20a02e1b456 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.825989:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.825993:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826000:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fa000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.826004:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826011:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826022:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826028:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d4caa11/0x9ba0f20a02e1b45d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826050:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.826054:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826059:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813faa00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.826062:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826069:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826079:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826086:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f3aba9/0x9ba0f20a02e1b464 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.826098:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.826100:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.826102:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.826411:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.826420:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.826433:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.826444:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.826462:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.826476:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.826487:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.826495:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.826517:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748598.827587:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.827596:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.827607:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fac00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.827621:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.827630:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.827647:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.827654:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040cac1c2/0x9ba0f20a02e1b46b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.827676:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.827678:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.827679:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.828928:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.828937:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.828951:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.828954:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.828960:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.828972:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.828982:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.828996:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.829016:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748598.829179:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.829185:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.829194:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.829197:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.829200:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.829209:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.829217:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.829225:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.829234:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788748598.830890:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.830905:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.830914:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.830928:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fee00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.830932:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.830943:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.830962:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.830985:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5da38fe/0x9ba0f20a02e1b472 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.831013:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.831017:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.831025:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fe400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.831028:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.831035:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.831047:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.831055:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062ad5033/0x9ba0f20a02e1b479 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.831069:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.831070:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.831072:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788748598.834736:0:19505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788748598.834777:0:19505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788748598.834791:0:19505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788748598.834876:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748598.835006:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17930:x1875638388716160:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53037us (53990us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788748598.835015:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:2.0:1788748598.835175:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.835184:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.835219:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.835224:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.835231:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.835244:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.835253:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.835260:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.835280:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748598.835983:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.835990:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.835999:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.836003:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.836007:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.836015:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.836034:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.836041:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.836053:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788748598.836720:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.836729:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836738:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ffa00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.836743:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836752:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836782:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836791:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfec64f9/0x9ba0f20a02e1b480 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836811:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.836815:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836821:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fea00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.836834:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836842:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836853:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836860:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e18b2268/0x9ba0f20a02e1b487 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.836876:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.836878:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.836880:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.836888:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.837004:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.837011:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.837020:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.837024:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.837028:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.837037:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.837046:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.837053:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.837089:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788748598.837662:0:17930:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788748598.837673:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17930:1875638388716160:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788748598.837690:0:17930:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788748598.837746:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17930:1875638388716288:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788748598.837809:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748598.837837:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add8842a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788748598.837865:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716288 00000100:00100000:1.0:1788748598.837871:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716288 00000100:00100000:1.0:1788748598.837916:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788748598.837926:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17930:x1875638388716288:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788748598.837984:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17930:x1875638388716288:12345-0@lo:900:osp-pre-1-1.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748598.837991:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788748598.838023:0:17930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbdc00 x1875638388716288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788748614 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748598.838032:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17930:1875638388716288:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788748598.839479:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.839501:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.839516:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.839532:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.839538:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.839566:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.839577:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.839601:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.839627:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788748598.839640:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.839649:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.839657:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.839660:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.839665:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.839675:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.839684:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.839691:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.839710:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788748598.840205:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788748598.840213:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840222:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ff600 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.840227:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840236:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840254:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840269:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000149bc4e8/0x9ba0f20a02e1b48e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840287:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.840291:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840298:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.840301:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840338:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840350:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840357:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b49c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840371:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.840375:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840381:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fec00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.840391:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840400:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840411:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840418:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000debf39b8/0x9ba0f20a02e1b495 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.840447:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.840450:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.840457:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.840464:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.840661:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.840668:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.840676:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.840685:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.840690:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.840701:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.840710:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.840717:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.840738:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788748598.841129:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.841136:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.841144:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.841147:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.841151:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.841159:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.841166:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.841179:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.841190:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788748598.841549:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.841556:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841564:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fe200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.841568:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841576:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841589:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841602:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cdff3bb/0x9ba0f20a02e1b4a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841619:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.841622:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841628:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fe000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.841631:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841639:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841648:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841655:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000739a695e/0x9ba0f20a02e1b4aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.841666:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.841668:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.841669:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.841676:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748598.841956:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.841963:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.841971:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.841975:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.841980:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.841989:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.841998:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.842005:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.842026:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748598.842593:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.842601:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.842615:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.842618:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.842622:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788748598.842773:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.842780:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.842787:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.842790:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.842794:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.842802:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.842809:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.842817:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.842830:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788748598.842995:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843006:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843013:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843022:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788748598.843192:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788748598.843200:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843214:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbaa00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.843217:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843226:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843239:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843245:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a62a73bf/0x9ba0f20a02e1b4b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843260:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.843263:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843269:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ff200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.843271:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843277:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843285:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843295:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd554fd/0x9ba0f20a02e1b4bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843329:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.843333:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843339:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba600 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.843341:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843348:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843357:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843364:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076f73f10/0x9ba0f20a02e1b4b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.843373:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.843375:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.843376:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.843381:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.843592:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.843598:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.843611:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.843614:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788748598.843619:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.843629:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.843637:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.843644:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.843663:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748598.843914:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.843925:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843933:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.843936:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.843941:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843950:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843969:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843976:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.843987:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788748598.845406:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.845417:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845446:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ff400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.845450:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845465:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845484:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845492:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fbfdd7f/0x9ba0f20a02e1b4c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845513:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.845516:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845522:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.845525:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845532:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845543:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845558:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb21ddc9/0x9ba0f20a02e1b4cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.845572:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.845574:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.845576:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.845583:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788748598.845776:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.845784:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748598.845793:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.845794:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.845798:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.845799:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.845804:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.845807:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.845810:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.845814:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.845816:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.845833:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.845836:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.845842:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.845844:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.845850:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.845864:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788748598.845869:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788748598.846180:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788748598.846186:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846193:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ff800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.846197:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846205:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846229:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846236:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c747b2/0x9ba0f20a02e1b4d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846250:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788748598.846253:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846266:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748598.846269:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748598.846271:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.846276:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846277:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846285:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.846288:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.846288:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846293:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846296:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006133d640/0x9ba0f20a02e1b4db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846302:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846309:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846336:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846336:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.846338:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.846340:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.846344:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748598.846349:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748598.846590:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.846596:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.846603:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbae00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.846606:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.846614:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.846626:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.846633:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecead642/0x9ba0f20a02e1b4e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.846646:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.846653:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748598.846655:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788748598.846655:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788748598.846661:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846674:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.846685:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.846690:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846700:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846708:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.846715:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748598.846718:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.846723:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846731:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.846734:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.846736:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788748598.846738:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846769:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846777:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846784:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.846795:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788748598.847098:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.847104:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847113:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.847116:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.847120:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847129:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847139:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847151:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847160:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788748598.847431:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.847437:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847446:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=515s v=(0 0) 00002000:00010000:0.0:1788748598.847453:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.847458:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.847459:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847463:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.847467:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.847471:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.847473:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.847474:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847482:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.847483:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847491:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.847492:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847499:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788748598.847510:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.847518:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788748598.847818:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.847836:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847849:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.847852:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.847857:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847867:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847875:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847882:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.847890:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788748598.848198:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.848204:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848212:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.848215:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.848219:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848227:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848245:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848251:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848258:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788748598.848420:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788748598.848427:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848446:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbbc00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.848450:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848459:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848475:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848483:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cdfc3a/0x9ba0f20a02e1b4e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848499:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788748598.848503:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848509:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940e00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.848513:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848532:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788748598.848536:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.848541:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848543:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848550:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788748598.848551:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055600368/0x9ba0f20a02e1b4f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848553:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.848557:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848563:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788748598.848566:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848567:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848574:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748598.848575:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848577:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848583:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848584:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848593:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848600:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000817d9d1/0x9ba0f20a02e1b4f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.848602:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788748598.848622:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788748598.848626:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848632:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbba00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.848635:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848644:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848653:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848660:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a2666f4/0x9ba0f20a02e1b4fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848672:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788748598.848675:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848682:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.848685:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848702:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848713:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848720:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848734:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788748598.848738:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848745:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.848748:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848756:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848777:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848784:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0ff87b0/0x9ba0f20a02e1b50c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848809:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748598.848813:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848819:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb600 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.848822:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848829:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848840:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848847:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecc1106b/0x9ba0f20a02e1b513 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848857:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.848860:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848867:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbbe00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.848870:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848888:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848898:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848905:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f87e2c51/0x9ba0f20a02e1b51a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.848916:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.848918:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.848919:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.848927:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788748598.849088:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.849094:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849102:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.849105:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.849109:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849116:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849124:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849130:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849152:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788748598.849488:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.849493:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849507:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.849520:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.849525:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849536:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849543:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849550:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849569:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788748598.849958:0:18693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788748598.849964:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849972:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788748598.849976:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788748598.849979:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849987:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.849995:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.850009:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748598.850085:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.850091:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.850098:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.850101:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.850105:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.850113:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.850121:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.850128:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748598.853437:0:18693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788748598.853441:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788748598.853452:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.853466:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.853471:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.853481:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.853502:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.853526:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075c63385/0x9ba0f20a02e1b521 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788748598.853590:0:18693:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788748598.853687:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17212:x1875638388715392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92476us (92994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748598.853783:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788748598.853909:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17212:1875638388715392:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788748598.853977:0:17212:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788748598.854023:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17212:1875638388716416:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788748598.854056:0:17212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748598.854079:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba607cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788748598.854097:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716416 00000100:00100000:3.0:1788748598.854103:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716416 00000100:00100000:3.0:1788748598.854139:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788748598.854148:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17212:x1875638388716416:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788748598.854182:0:19357:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1788748598.854332:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788748598.854338:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854347:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.854351:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854360:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854373:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854379:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d562f01f/0x9ba0f20a02e1b528 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854393:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788748598.854396:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854402:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbb800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.854411:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854418:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854429:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854436:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3016118/0x9ba0f20a02e1b52f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854448:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.854452:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854458:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.854461:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854467:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854476:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.854483:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.854490:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.854493:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788748598.856367:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788748598.856377:0:19687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9b1d06/0x9ba0f20a02e1b536 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.856586:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.857548:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.859704:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.859715:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.859732:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.859737:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.859743:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.859757:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.859778:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.859787:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.859811:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748598.860022:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.860029:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.860038:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.860043:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.860052:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.860070:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.860078:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000726a463d/0x9ba0f20a02e1b53d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.860097:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.860099:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.860101:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.860548:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.860555:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.860564:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.860567:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.860578:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.860588:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.860596:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.860603:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.860624:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748598.860651:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748598.860657:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.860665:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940000 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.860668:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.860675:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.860686:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.860694:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b43002/0x9ba0f20a02e1b544 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.860708:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.860710:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.860718:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.860975:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.860980:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.860988:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.860991:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.860995:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861004:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861012:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861030:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861051:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748598.861077:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.861083:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.861090:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941a00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.861101:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.861109:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.861120:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.861128:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c5c7d3/0x9ba0f20a02e1b54b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.861141:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.861143:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.861145:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.861418:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.861424:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861432:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.861435:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.861439:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861458:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861467:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861474:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.861492:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748598.861525:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748598.861530:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.861537:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.861541:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.861548:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.861560:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.861567:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b67a1ce/0x9ba0f20a02e1b552 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.861581:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.861583:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.861584:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.863384:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.863396:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.863421:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.863425:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.863430:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.863442:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.863463:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.863471:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.863494:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788748598.863673:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788748598.863681:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.863699:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940e00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:2.0:1788748598.863703:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.863712:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.863727:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.863741:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055600368/0x9ba0f20a02e1b559 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748598.863768:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.863770:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748598.863772:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788748598.864175:0:19687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788748598.864182:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.864191:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788748598.864195:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748598.864199:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.864208:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.864229:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.864236:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748598.864258:0:19687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748598.864293:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:0.0:1788748598.864298:0:19687:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:1.0:1788748598.864299:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.864306:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d77400 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748598.864337:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.864358:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.864386:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.864393:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fdaf4e/0x9ba0f20a02e1b560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748598.864408:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.864410:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748598.864412:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748598.865292:0:19687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17210:x1875638388715904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89423us (99254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748598.865304:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748598.868015:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17212:x1875638388716416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13862us (13951us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788748598.868026:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788748598.868102:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17212:1875638388716416:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788748598.868117:0:17212:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1788748598.869245:0:17210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17210:1875638388715904:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788748598.869260:0:17210:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788748598.869306:0:17210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17210:1875638388716544:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788748598.869364:0:17210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748598.869386:0:17210:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add9eaaf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748598.869463:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716544 00000100:00100000:0.0:1788748598.869471:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716544 00000100:00100000:0.0:1788748598.869520:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788748598.869529:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17210:x1875638388716544:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788748598.869566:0:18690:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1788748598.882830:0:18687:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788748598.882872:0:18687:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788748598.883273:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17210:x1875638388716544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13741us (13904us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788748598.883284:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788748598.883675:0:17210:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788748598.883686:0:17210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17210:1875638388716544:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788748598.883703:0:17210:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:2.0:1788748599.141685:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788748599.205247:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748600.229454:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748601.253467:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748601.371921:0:19863:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1788748602.125908:0:19915:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788748602.126181:0:19915:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788748602.282991:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788748603.053162:0:19965:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788748603.053656:0:19965:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788748603.173307:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748603.173349:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388716672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748603.173416:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748603.173487:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716672 00000100:00100000:1.0:1788748603.173495:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716672 00000100:00100000:1.0:1788748603.174257:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748603.174281:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388716672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748603.174342:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788748603.174409:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388716672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.174417:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788748603.174465:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388716672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788748603.177457:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788748603.177480:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388716800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748603.177554:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748603.177610:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716800 00000100:00100000:1.0:1788748603.177617:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716800 00000100:00100000:1.0:1788748603.177656:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748603.177664:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388716800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788748603.177697:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788748603.177752:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388716800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.177759:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788748603.177799:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388716800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748603.178961:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788748603.178978:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388716928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748603.179026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748603.179076:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388716928 00000100:00100000:3.0:1788748603.179082:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388716928 00000100:00080000:1.0:1788748603.179226:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748603.179253:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748603.179265:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388716928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748603.179292:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788748603.179361:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388716928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.179367:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788748603.179448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388716928:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788748603.300564:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748603.331138:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.331225:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368716672 00000100:00100000:3.0:1788748603.331235:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368716672 00000100:00100000:3.0:1788748603.331288:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:3.0:1788748603.331297:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add96c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2409:x1875638368716672:12345-192.168.203.22@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788748603.331356:0:17177:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from b5c63e85-f7a2-441c-9884-b3ba050117ac@192.168.203.22@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1788748603.331393:0:17177:0:(genops.c:1384:class_connect()) connect: client b5c63e85-f7a2-441c-9884-b3ba050117ac, cookie 0x9ba0f20a02e1b567 00000100:00080000:2.0:1788748603.331754:0:17177:0:(import.c:65:import_set_state_nolock()) ffff8adc83ebd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748603.331829:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add96c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+5:2409:x1875638368716672:12345-192.168.203.22@tcp:250:mount.lustre.0 Request processed in 531us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.331837:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:0.0:1788748603.339655:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.339840:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368716800 00000100:00100000:3.0:1788748603.339851:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368716800 00000100:00100000:3.0:1788748603.339964:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:3.0:1788748603.339976:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add96c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+5:14898:x1875638368716800:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748603.339994:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748603.340022:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e1b56e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f73 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.340052:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e1b56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f73 expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.340063:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bba200/0x9ba0f20a02e1b56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f73 expref: 6 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.340091:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bba200, rc 0) 00000100:00100000:3.0:1788748603.340150:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add96c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+6:14898:x1875638368716800:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 177us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.340157:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:0.0:1788748603.351342:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748603.351437:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368716928 00000100:00100000:2.0:1788748603.351446:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368716928 00000100:00100000:2.0:1788748603.351545:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:2.0:1788748603.351554:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add813ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+6:14898:x1875638368716928:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788748603.351667:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add813ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+6:14898:x1875638368716928:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 114us (361us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788748603.351674:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:2.0:1788748603.355597:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.355674:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717056 00000100:00100000:3.0:1788748603.355751:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717056 00000100:00100000:3.0:1788748603.355810:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:3.0:1788748603.355822:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add888c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+6:14898:x1875638368717056:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748603.355849:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748603.355869:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1b575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3f7a expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.356171:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1b575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f7a expref: 7 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.356185:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbac00/0x9ba0f20a02e1b575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3f7a expref: 7 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.356195:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbac00, rc 0) 00000100:00100000:3.0:1788748603.356256:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add888c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+7:14898:x1875638368717056:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 437us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.356263:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:0.0:1788748603.360932:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748603.361520:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717184 00000100:00100000:2.0:1788748603.361531:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717184 00000100:00100000:2.0:1788748603.361587:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:2.0:1788748603.361596:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add888c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+7:14898:x1875638368717184:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788748603.361775:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add888c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14898:x1875638368717184:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 179us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.361783:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1788748603.369286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.369429:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717312 00000100:00100000:3.0:1788748603.369439:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717312 00000100:00100000:3.0:1788748603.369488:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:3.0:1788748603.369498:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14898:x1875638368717312:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788748603.370114:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14898:x1875638368717312:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 616us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.370124:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:3.0:1788748603.387864:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.388051:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717440 00000100:00100000:1.0:1788748603.388132:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717440 00000100:00100000:1.0:1788748603.388538:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:1.0:1788748603.388549:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14917:x1875638368717440:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748603.388718:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14917:x1875638368717440:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 171us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.388744:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:0.0:1788748603.418759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.418848:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717568 00000100:00100000:3.0:1788748603.418857:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717568 00000100:00100000:3.0:1788748603.418914:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:3.0:1788748603.418924:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14917:x1875638368717568:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748603.419085:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14917:x1875638368717568:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 161us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.419093:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:0.0:1788748603.424658:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.427102:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717696 00000100:00100000:1.0:1788748603.427118:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717696 00000100:00100000:3.0:1788748603.427310:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1788748603.427365:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14917:x1875638368717696:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748603.427522:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14917:x1875638368717696:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 161us (2872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.427530:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:0.0:1788748603.430671:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748603.430773:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717824 00000100:00100000:2.0:1788748603.430782:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717824 00000100:00100000:2.0:1788748603.430840:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:2.0:1788748603.430850:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+8:14898:x1875638368717824:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788748603.430866:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748603.430884:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adda73ff600/0x9ba0f20a02e1b57c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3fab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748603.430912:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adda73ff600/0x9ba0f20a02e1b57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fab expref: 9 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748603.430924:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adda73ff600/0x9ba0f20a02e1b57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fab expref: 9 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748603.430960:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73ff600, rc 0) 00000100:00100000:2.0:1788748603.431019:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+9:14898:x1875638368717824:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 170us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.431027:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:0.0:1788748603.436304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.436587:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368717952 00000100:00100000:1.0:1788748603.436597:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368717952 00000100:00100000:1.0:1788748603.436651:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:1.0:1788748603.436661:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+9:14898:x1875638368717952:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788748603.436685:0:17180:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788748603.436709:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788748603.436713:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788748603.436716:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788748603.436719:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788748603.436721:0:17180:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788748603.441840:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+9:14898:x1875638368717952:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 5171us (5534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.441855:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:0.0:1788748603.445872:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.445956:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718080 00000100:00100000:3.0:1788748603.445965:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718080 00000100:00100000:3.0:1788748603.446015:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:3.0:1788748603.446025:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+9:14898:x1875638368718080:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788748603.446041:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748603.446058:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3fb2 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.446085:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 10 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.446111:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 10 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748603.446119:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb800, rc 0) 00000100:00100000:3.0:1788748603.446187:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14898:x1875638368718080:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 162us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.446194:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:0.0:1788748603.454079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.454170:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718208 00000100:00100000:1.0:1788748603.454181:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718208 00000100:00100000:1.0:1788748603.454232:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:1.0:1788748603.454242:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14898:x1875638368718208:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788748603.454467:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14898:x1875638368718208:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 225us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.454477:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:0.0:1788748603.461359:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748603.461469:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718336 00000100:00100000:2.0:1788748603.461484:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718336 00000100:00100000:2.0:1788748603.461558:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:2.0:1788748603.461570:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14898:x1875638368718336:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788748603.461740:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14898:x1875638368718336:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 162us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.461748:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:0.0:1788748603.476511:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.477080:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718464 00000100:00100000:3.0:1788748603.477093:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718464 00000100:00100000:3.0:1788748603.477606:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:3.0:1788748603.477621:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14922:x1875638368718464:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788748603.478157:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14922:x1875638368718464:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 536us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.478169:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:0.0:1788748603.487891:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.492935:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718592 00000100:00100000:1.0:1788748603.493564:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718592 00000100:00100000:1.0:1788748603.493664:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:1.0:1788748603.493678:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14922:x1875638368718592:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788748603.493915:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:14922:x1875638368718592:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 240us (6038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.493923:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:0.0:1788748603.499980:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.500593:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718720 00000100:00100000:1.0:1788748603.500607:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718720 00000100:00100000:1.0:1788748603.500669:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1788748603.500679:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2409:x1875638368718720:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788748603.500735:0:18714:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 214085a6-5521-4af6-bbcd-d13001081488@192.168.203.22@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1788748603.500806:0:18714:0:(genops.c:1384:class_connect()) connect: client 214085a6-5521-4af6-bbcd-d13001081488, cookie 0x9ba0f20a02e1b58a 00000004:00100000:1.0:1788748603.500838:0:18714:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788748603.501704:0:18714:0:(import.c:65:import_set_state_nolock()) ffff8adc83e50800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748603.501821:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:2409:x1875638368718720:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 1140us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.501833:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788748603.508625:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748603.508933:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748603.513535:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368719360 00000100:00100000:2.0:1788748603.513558:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368719360 00000100:00100000:2.0:1788748603.513655:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:2.0:1788748603.513668:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:2411:x1875638368719360:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748603.513799:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:2411:x1875638368719360:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 132us (5190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.513807:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:3.0:1788748603.513903:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718976 00000100:00100000:3.0:1788748603.513910:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718976 00000100:00100000:3.0:1788748603.514001:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788748603.514008:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2409:x1875638368718976:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788748603.514041:0:17184:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from 214085a6-5521-4af6-bbcd-d13001081488@192.168.203.22@tcp t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1788748603.514227:0:17184:0:(genops.c:1384:class_connect()) connect: client 214085a6-5521-4af6-bbcd-d13001081488, cookie 0x9ba0f20a02e1b591 00000004:00100000:3.0:1788748603.514277:0:17184:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788748603.514379:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00080000:3.0:1788748603.514590:0:17184:0:(import.c:65:import_set_state_nolock()) ffff8adc84397000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788748603.514657:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+6:2409:x1875638368718976:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 648us (5724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.514665:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788748603.525382:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368719232 00000100:00100000:3.0:1788748603.525405:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368719232 00000100:00100000:3.0:1788748603.525888:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1788748603.525921:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368719232:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788748603.525966:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788748603.527047:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368719232:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 1124us (12662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748603.527061:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:3.0:1788748603.527372:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788748603.533102:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.533151:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748603.533207:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748603.533401:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368718848 00000100:00100000:0.0:1788748603.533414:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368718848 00000100:00100000:0.0:1788748603.533490:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368719104 00000100:00100000:0.0:1788748603.533493:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368719104 00000100:00100000:0.0:1788748603.533524:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368719488 00000100:00100000:0.0:1788748603.533527:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368719488 00000100:00100000:0.0:1788748603.533544:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788748603.533556:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+7:0:x1875638368718848:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788748603.533600:0:18714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788748603.533689:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+7:0:x1875638368718848:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 135us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748603.533697:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788748603.533718:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1788748603.533726:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:0:x1875638368719104:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788748603.533768:0:18714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788748603.533820:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:0:x1875638368719104:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 94us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748603.533826:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1788748603.533839:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1788748603.533846:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368719488:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788748603.533876:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368719488:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748603.533882:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00080000:0.0:1788748603.533901:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748603.538662:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748603.538795:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748603.538843:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748603.538897:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368719616 00000100:00100000:3.0:1788748603.538912:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368719616 00000100:00100000:3.0:1788748603.538968:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368719744 00000100:00100000:3.0:1788748603.538972:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368719744 00000100:00100000:3.0:1788748603.539001:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1788748603.539012:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875638368719616:12345-192.168.203.22@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788748603.539047:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368719872 00000100:00100000:1.0:1788748603.539054:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368719872 00010000:00080000:3.0:1788748603.539060:0:18692:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 214085a6-5521-4af6-bbcd-d13001081488@192.168.203.22@tcp t0 exp 0000000000000000 cur 520 last 0 00000100:00100000:1.0:1788748603.539101:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1788748603.539110:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368719872:12345-192.168.203.22@tcp:900:mount.lustre.0 00000020:00000080:3.0:1788748603.539123:0:18692:0:(genops.c:1384:class_connect()) connect: client 214085a6-5521-4af6-bbcd-d13001081488, cookie 0x9ba0f20a02e1b598 00002000:00100000:3.0:1788748603.539139:0:18692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 214085a6-5521-4af6-bbcd-d13001081488/ffff8adc84397800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788748603.539153:0:18692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788748603.539210:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368719872:12345-192.168.203.22@tcp:900:mount.lustre.0 Request processed in 99us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748603.539218:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1788748603.539312:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788748603.539380:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2409:x1875638368719744:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788748603.539426:0:19357:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 214085a6-5521-4af6-bbcd-d13001081488@192.168.203.22@tcp t0 exp 0000000000000000 cur 520 last 0 00002000:00080000:3.0:1788748603.539437:0:18692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1788748603.539466:0:19357:0:(genops.c:1384:class_connect()) connect: client 214085a6-5521-4af6-bbcd-d13001081488, cookie 0x9ba0f20a02e1b59f 00002000:00100000:2.0:1788748603.539480:0:19357:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 214085a6-5521-4af6-bbcd-d13001081488/ffff8adc83eb8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788748603.539498:0:19357:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788748603.539694:0:19357:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788748603.539740:0:19357:0:(import.c:65:import_set_state_nolock()) ffff8adc83ebb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748603.539819:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:214085a6-5521-4af6-bbcd-d13001081488+6:2409:x1875638368719744:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 444us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.539827:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00080000:2.0:1788748603.541232:0:18692:0:(import.c:65:import_set_state_nolock()) ffff8adc84393000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788748603.541408:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:214085a6-5521-4af6-bbcd-d13001081488+6:2409:x1875638368719616:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 2393us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748603.541418:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788748603.547504:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748603.547812:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720000 00000100:00100000:0.0:1788748603.547822:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720000 00000100:00100000:0.0:1788748603.547878:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1788748603.547889:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368720000:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788748603.549899:0:17187:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1912us 00000004:00200000:0.0:1788748603.564810:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788748603.564956:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+6:14898:x1875638368720000:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 17064us (17455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748603.564968:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788748603.726442:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748603.726561:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720128 00000100:00100000:0.0:1788748603.726571:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720128 00000100:00100000:0.0:1788748603.726629:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1788748603.726640:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:14945:x1875638368720128:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:0.0:1788748603.726659:0:18714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748603.726697:0:18714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1b5a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3fe3 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748603.726777:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b5ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748603.726790:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b5ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748603.726805:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b5ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748603.726854:0:18714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788748603.726858:0:18714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748603.726893:0:18714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b5ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748603.726918:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc941a00/0x9ba0f20a02e1b5a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fe3 expref: 8 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748603.726937:0:18714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b5ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fe3 expref: 7 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748603.727023:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:0.0:1788748603.727026:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788748603.727029:0:18714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940e00, rc 0) 00000100:00100000:0.0:1788748603.727092:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+7:14945:x1875638368720128:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 454us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748603.727099:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1788748604.196609:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388717056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748604.196785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388717312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748604.196855:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748604.196902:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388717184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748604.196983:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748604.197038:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388717696:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.197084:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748604.197096:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748604.197124:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388717568:0@lo:400:kworker.0 00000100:00100000:3.0:1788748604.197129:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388718208:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.197173:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748604.197183:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748604.197214:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388718720:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.197239:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388718080:0@lo:400:kworker.0 00000100:00100000:1.0:1788748604.197260:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717696 00000100:00100000:3.0:1788748604.197267:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748604.197271:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717696 00000100:00100000:0.0:1788748604.197278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748604.197310:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388718592:0@lo:400:kworker.0 00000100:00100000:3.0:1788748604.197361:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388717440:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.197381:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748604.197398:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718208 00000100:00100000:1.0:1788748604.197413:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718208 00000100:00100000:1.0:1788748604.197435:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718080 00000100:00100000:1.0:1788748604.197439:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718080 00000100:00100000:1.0:1788748604.197456:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788748604.197464:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388717696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748604.197557:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717312 00000100:00100000:2.0:1788748604.197562:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717312 00000100:00100000:2.0:1788748604.197585:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717184 00000100:00100000:2.0:1788748604.197587:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717184 00000100:00100000:2.0:1788748604.197597:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717056 00000100:00100000:2.0:1788748604.197600:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717056 00000100:00100000:2.0:1788748604.197611:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748604.197618:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388717312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788748604.197631:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788748604.197855:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748604.197869:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875638388718208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.197930:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1875638388718208:12345-0@lo:400:kworker.0 Request processed in 67us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748604.197938:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788748604.197964:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788748604.197971:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388718080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.198008:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388718080:12345-0@lo:400:kworker.0 Request processed in 37us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748604.198014:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788748604.198032:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788748604.198038:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788748604.198073:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388718080:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.198132:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388717824:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.198163:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748604.198186:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388718336:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.198925:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748604.198971:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388718848:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.199004:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748604.199043:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718720 00000100:00100000:0.0:1788748604.199051:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718720 00000100:00100000:0.0:1788748604.199096:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718592 00000100:00100000:0.0:1788748604.199099:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718592 00000100:00100000:0.0:1788748604.199113:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717824 00000100:00100000:0.0:1788748604.199115:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717824 00000100:00100000:0.0:1788748604.199125:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718336 00000100:00100000:0.0:1788748604.199127:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718336 00000100:00100000:0.0:1788748604.199137:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718848 00000100:00100000:0.0:1788748604.199139:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718848 00000100:00100000:0.0:1788748604.199156:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748604.199163:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388718720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.199228:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875638388718720:12345-0@lo:400:kworker.0 Request processed in 60us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748604.199235:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788748604.199252:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748604.199258:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388718592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.199293:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875638388718592:12345-0@lo:400:kworker.0 Request processed in 35us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748604.199300:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788748604.199312:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748604.199335:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388717824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.199370:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388717824:12345-0@lo:400:kworker.0 Request processed in 53us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748604.199376:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788748604.199387:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748604.199400:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388718336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.199432:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388718336:12345-0@lo:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748604.199438:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788748604.199463:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788748604.199470:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388718848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.199498:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388718848:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748604.199505:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788748604.199667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788748604.199837:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788748604.199845:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788748604.199885:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388717824:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.199898:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388718336:0@lo:400:kworker.0 00010000:00080000:0.0:1788748604.199912:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc849a8000 x1875638388718848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748604.199924:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388718848:0@lo:400:kworker.0 00010000:00080000:0.0:1788748604.199969:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc849a9180 x1875638388718592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788748604.199979:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875638388718592:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.200081:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717440 00000100:00100000:0.0:1788748604.200087:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717440 00000100:00100000:0.0:1788748604.200124:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788748604.200131:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3638:x1875638388717440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748604.201158:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388717312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3533us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748604.201184:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788748604.201220:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748604.201230:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388717184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788748604.201254:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788748604.201292:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875638388717184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (4311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748604.201296:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788748604.201306:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748604.201310:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388717056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748604.202019:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788748604.202073:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388717056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 760us (4991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748604.202080:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788748604.202146:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388717312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748604.202189:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388717056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748604.202266:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717568 00000100:00100000:2.0:1788748604.202274:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717568 00000100:00100000:2.0:1788748604.202312:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788748604.202340:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388717568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748604.202384:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8380ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388717568:12345-0@lo:400:kworker.0 Request processed in 46us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748604.202391:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788748604.202427:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388717568:0@lo:400:kworker.0 00000100:00100000:2.0:1788748604.202473:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875638388718720:0@lo:400:kworker.0 00000100:00100000:2.0:1788748604.202822:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388718208:0@lo:400:kworker.0 00000100:00100000:1.0:1788748604.202843:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388717696:12345-0@lo:400:kworker.0 Request processed in 5377us (5749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748604.202852:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388717184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748604.202856:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788748604.202882:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388717696:0@lo:400:kworker.0 00000100:00100000:3.0:1788748604.203938:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388717952:0@lo:400:kworker.0 00000100:00100000:3.0:1788748604.204016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748604.204053:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388718464:0@lo:400:kworker.0 00000100:00100000:3.0:1788748604.204082:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748604.204219:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718464 00000100:00100000:2.0:1788748604.204230:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718464 00000100:00100000:0.0:1788748604.204280:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf478c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3638:x1875638388717440:12345-0@lo:400:kworker.0 Request processed in 4146us (4611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748604.204435:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748604.204446:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388718464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748604.204503:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388718464:12345-0@lo:400:kworker.0 Request processed in 60us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748604.204525:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788748604.204584:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388717440:0@lo:400:kworker.0 00000100:00100000:2.0:1788748604.204603:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388718464:0@lo:400:kworker.0 00000100:00100000:0.0:1788748604.204620:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788748604.204853:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388717952 00000100:00100000:1.0:1788748604.204859:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388717952 00000100:00100000:1.0:1788748604.204902:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788748604.204912:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388717952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748604.204986:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388717952:12345-0@lo:400:kworker.0 Request processed in 76us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748604.204993:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788748604.205074:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388717952:0@lo:400:kworker.0 00000100:00080000:3.0:1788748604.213197:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788748604.326062:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788748604.717974:0:18687:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 214085a6-5521-4af6-bbcd-d13001081488 00000001:00100000:2.0:1788748605.229299:0:19505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 214085a6-5521-4af6-bbcd-d13001081488 00000001:00080000:2.0:1788748605.229347:0:19505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1788748605.349273:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748605.733423:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788748605.753622:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748605.755765:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720256 00000100:00100000:1.0:1788748605.755785:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720256 00000100:00100000:1.0:1788748605.755995:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1788748605.756009:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+7:14997:x1875638368720256:12345-192.168.203.22@tcp:41:lfs.0 00000004:00000024:1.0:1788748605.756064:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788748605.756199:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+7:14997:x1875638368720256:12345-192.168.203.22@tcp:41:lfs.0 Request processed in 193us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748605.756278:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00080000:3.0:1788748605.760457:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788748605.770179:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748605.770292:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720384 00000100:00100000:0.0:1788748605.770305:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720384 00000100:00100000:0.0:1788748605.770423:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788748605.770435:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:14997:x1875638368720384:12345-192.168.203.22@tcp:41:lfs.0 00000004:00000024:0.0:1788748605.770489:0:18714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788748605.770602:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:14997:x1875638368720384:12345-192.168.203.22@tcp:41:lfs.0 Request processed in 169us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.770611:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00080000:3.0:1788748605.770746:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748605.780136:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748605.780961:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720512 00000100:00100000:2.0:1788748605.780977:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720512 00000100:00100000:2.0:1788748605.781105:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788748605.781115:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:214085a6-5521-4af6-bbcd-d13001081488+5:14997:x1875638368720512:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:2.0:1788748605.781159:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788748605.781287:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:214085a6-5521-4af6-bbcd-d13001081488+5:14997:x1875638368720512:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 172us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748605.781312:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:3.0:1788748605.781659:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788748605.783824:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748605.784066:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720640 00000100:00100000:0.0:1788748605.784080:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720640 00000100:00100000:0.0:1788748605.784150:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788748605.784164:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:214085a6-5521-4af6-bbcd-d13001081488+5:14997:x1875638368720640:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:0.0:1788748605.784209:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788748605.784391:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:214085a6-5521-4af6-bbcd-d13001081488+5:14997:x1875638368720640:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 230us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.784399:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:3.0:1788748605.784510:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748605.947447:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748605.947614:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720768 00000100:00100000:2.0:1788748605.947627:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720768 00000100:00100000:2.0:1788748605.947750:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:2.0:1788748605.947763:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+10:15029:x1875638368720768:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788748605.947787:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748605.947810:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adda73fee00/0x9ba0f20a02e1b5b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa3fea expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.947852:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adda73fee00/0x9ba0f20a02e1b5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fea expref: 11 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.947865:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adda73fee00/0x9ba0f20a02e1b5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fea expref: 11 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748605.947875:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73fee00, rc 0) 00000100:00100000:2.0:1788748605.947952:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15029:x1875638368720768:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 191us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748605.947960:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:1.0:1788748605.950619:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748605.950734:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368720896 00000100:00100000:0.0:1788748605.950748:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368720896 00000100:00100000:0.0:1788748605.950858:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:0.0:1788748605.950871:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15029:x1875638368720896:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788748605.951132:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15029:x1875638368720896:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 263us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.951141:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:1.0:1788748605.965467:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748605.965583:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721024 00000100:00100000:0.0:1788748605.965595:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721024 00000100:00100000:0.0:1788748605.965658:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:0.0:1788748605.965669:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15029:x1875638368721024:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788748605.966445:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15029:x1875638368721024:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 773us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748605.966455:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:3.0:1788748605.983249:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748605.983361:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721152 00000100:00100000:2.0:1788748605.983375:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721152 00000100:00100000:2.0:1788748605.983446:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:2.0:1788748605.983458:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15036:x1875638368721152:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788748605.984768:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf479050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15036:x1875638368721152:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 1305us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748605.984796:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:1.0:1788748606.003598:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748606.003850:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721280 00000100:00100000:0.0:1788748606.003864:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721280 00000100:00100000:0.0:1788748606.003936:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:0.0:1788748606.003946:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbf47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15036:x1875638368721280:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748606.004604:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbf47a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15036:x1875638368721280:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 655us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748606.004614:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:1.0:1788748606.009689:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748606.010209:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721408 00000100:00100000:3.0:1788748606.010224:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721408 00000100:00100000:3.0:1788748606.010484:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1788748606.010498:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15036:x1875638368721408:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748606.010699:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15036:x1875638368721408:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 204us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748606.010708:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1788748606.014681:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748606.014872:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721536 00000100:00100000:0.0:1788748606.014885:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721536 00000100:00100000:0.0:1788748606.015198:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:0.0:1788748606.015211:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:15029:x1875638368721536:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748606.015235:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748606.015269:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b5bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa401b expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748606.015364:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa401b expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748606.015377:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941400/0x9ba0f20a02e1b5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa401b expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748606.015388:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941400, rc 0) 00000100:00100000:0.0:1788748606.015478:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:15029:x1875638368721536:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 271us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748606.015487:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:0.0:1788748606.021526:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748606.021643:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721664 00000100:00100000:3.0:1788748606.021657:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721664 00000100:00100000:3.0:1788748606.021739:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:3.0:1788748606.021752:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:15029:x1875638368721664:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788748606.021785:0:17180:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788748606.021825:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788748606.021829:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788748606.021833:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788748606.021836:0:17180:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788748606.021839:0:17180:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788748606.023210:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:15029:x1875638368721664:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 1452us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748606.023225:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:1.0:1788748606.026931:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748606.027045:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721792 00000100:00100000:0.0:1788748606.027058:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721792 00000100:00100000:0.0:1788748606.027245:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:0.0:1788748606.027357:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:15029:x1875638368721792:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788748606.027382:0:17177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748606.027416:0:17177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4022 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748606.027453:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 13 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748606.027463:0:17177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 13 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748606.027471:0:17177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940000, rc 0) 00000100:00100000:0.0:1788748606.027526:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15029:x1875638368721792:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 176us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748606.027546:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:0.0:1788748606.029985:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748606.030308:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368721920 00000100:00100000:3.0:1788748606.030353:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368721920 00000100:00100000:3.0:1788748606.030429:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:3.0:1788748606.030441:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15029:x1875638368721920:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788748606.030660:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15029:x1875638368721920:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 221us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748606.030669:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:2.0:1788748606.033032:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748606.033308:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722048 00000100:00100000:0.0:1788748606.033366:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722048 00000100:00100000:0.0:1788748606.033448:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:0.0:1788748606.033471:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15029:x1875638368722048:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788748606.033680:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15029:x1875638368722048:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 221us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748606.033692:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:1.0:1788748606.037771:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748606.038003:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722176 00000100:00100000:0.0:1788748606.038018:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722176 00000100:00100000:0.0:1788748606.038098:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:0.0:1788748606.038110:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15042:x1875638368722176:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788748606.038607:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15042:x1875638368722176:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 497us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748606.038617:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:1.0:1788748606.051470:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748606.058428:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722304 00000100:00100000:3.0:1788748606.058449:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722304 00000100:00100000:3.0:1788748606.058534:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:3.0:1788748606.058546:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15042:x1875638368722304:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788748606.058774:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:15042:x1875638368722304:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 230us (7318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748606.058783:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:2.0:1788748606.069185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748606.069627:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722432 00000100:00100000:1.0:1788748606.069641:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722432 00000100:00100000:1.0:1788748606.069706:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788748606.069727:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2409:x1875638368722432:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788748606.069769:0:17186:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 75569442-d759-49f9-ac7f-46ed0f7f5707@192.168.203.22@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1788748606.069820:0:17186:0:(genops.c:1384:class_connect()) connect: client 75569442-d759-49f9-ac7f-46ed0f7f5707, cookie 0x9ba0f20a02e1b5c9 00000004:00100000:1.0:1788748606.069855:0:17186:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788748606.069983:0:17186:0:(import.c:65:import_set_state_nolock()) ffff8add85953800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748606.070075:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2409:x1875638368722432:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 348us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748606.070085:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1788748606.070205:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748606.070283:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722688 00000100:00100000:1.0:1788748606.070288:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722688 00000100:00100000:1.0:1788748606.070345:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1788748606.070351:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2409:x1875638368722688:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788748606.070373:0:17185:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0001: connection from 75569442-d759-49f9-ac7f-46ed0f7f5707@192.168.203.22@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1788748606.070548:0:17185:0:(genops.c:1384:class_connect()) connect: client 75569442-d759-49f9-ac7f-46ed0f7f5707, cookie 0x9ba0f20a02e1b5d0 00000004:00100000:1.0:1788748606.070565:0:17185:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788748606.070631:0:17185:0:(import.c:65:import_set_state_nolock()) ffff8add85951000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748606.070667:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2409:x1875638368722688:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 314us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748606.070675:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1788748606.073704:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748606.073761:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748606.073870:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722816 00000100:00100000:2.0:1788748606.073884:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722816 00000100:00100000:2.0:1788748606.073954:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722560 00000100:00100000:2.0:1788748606.073957:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722560 00000100:00100000:2.0:1788748606.073991:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788748606.074002:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+6:0:x1875638368722816:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788748606.074053:0:17184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1788748606.074118:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788748606.074124:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788748606.074159:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1788748606.074169:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:0:x1875638368722560:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788748606.074211:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788748606.074280:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:0:x1875638368722560:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 114us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748606.074288:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788748606.075399:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+6:0:x1875638368722816:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 1389us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748606.075423:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788748606.076492:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748606.077175:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368722944 00000100:00100000:2.0:1788748606.077187:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368722944 00000100:00100000:2.0:1788748606.077457:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1788748606.077469:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368722944:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788748606.077507:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788748606.077594:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368722944:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 128us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748606.077601:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788748606.079375:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748606.080448:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723072 00000100:00100000:0.0:1788748606.080463:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723072 00000100:00100000:0.0:1788748606.080545:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1788748606.080556:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368723072:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788748606.080660:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368723072:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 106us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748606.080668:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1788748606.083902:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748606.084276:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723456 00000100:00100000:2.0:1788748606.084290:0:17196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723456 00000100:00100000:2.0:1788748606.084412:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1788748606.084425:0:17196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368723456:12345-192.168.203.22@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788748606.084545:0:17196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368723456:12345-192.168.203.22@tcp:900:mount.lustre.0 Request processed in 122us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748606.084555:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1788748606.085728:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748606.085788:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748606.085830:0:19687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723200 00000100:00100000:1.0:1788748606.085844:0:19687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723200 00000100:00100000:2.0:1788748606.085867:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723328 00000100:00100000:2.0:1788748606.085872:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723328 00000100:00100000:1.0:1788748606.085894:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788748606.085903:0:19687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2409:x1875638368723200:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788748606.085956:0:19687:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 75569442-d759-49f9-ac7f-46ed0f7f5707@192.168.203.22@tcp t0 exp 0000000000000000 cur 523 last 0 00000100:00100000:2.0:1788748606.085959:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788748606.085965:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875638368723328:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788748606.085982:0:18690:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 75569442-d759-49f9-ac7f-46ed0f7f5707@192.168.203.22@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1788748606.085995:0:19687:0:(genops.c:1384:class_connect()) connect: client 75569442-d759-49f9-ac7f-46ed0f7f5707, cookie 0x9ba0f20a02e1b5d7 00000020:00000080:2.0:1788748606.085999:0:18690:0:(genops.c:1384:class_connect()) connect: client 75569442-d759-49f9-ac7f-46ed0f7f5707, cookie 0x9ba0f20a02e1b5de 00002000:00100000:1.0:1788748606.086009:0:19687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 75569442-d759-49f9-ac7f-46ed0f7f5707/ffff8add85956800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788748606.086012:0:18690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75569442-d759-49f9-ac7f-46ed0f7f5707/ffff8adc83ebd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788748606.086023:0:18690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788748606.086023:0:19687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788748606.086117:0:18690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1788748606.086117:0:19687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788748606.086150:0:18690:0:(import.c:65:import_set_state_nolock()) ffff8adc83eb9800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788748606.086150:0:19687:0:(import.c:65:import_set_state_nolock()) ffff8add85954000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788748606.086213:0:19687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2409:x1875638368723200:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 309us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748606.086220:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788748606.087814:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2409:x1875638368723328:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 1834us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748606.087829:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1788748606.088839:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748606.089141:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723584 00000100:00100000:2.0:1788748606.089152:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723584 00000100:00100000:2.0:1788748606.089247:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:2.0:1788748606.089269:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368723584:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788748606.089423:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788748606.089526:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15029:x1875638368723584:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 258us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748606.089533:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1788748606.217185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748606.217351:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723712 00000100:00100000:1.0:1788748606.217382:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723712 00000100:00100000:1.0:1788748606.217596:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1788748606.217609:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15065:x1875638368723712:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:1.0:1788748606.217637:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748606.217666:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b5e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4053 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748606.217759:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748606.217776:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748606.217795:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748606.217858:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788748606.217862:0:17185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748606.217888:0:17185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748606.217919:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b5e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 8 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748606.217942:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748606.217951:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:1.0:1788748606.217955:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748606.217959:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69200, rc 0) 00000100:00100000:1.0:1788748606.218054:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+7:15065:x1875638368723712:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 447us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748606.218062:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00010000:00010000:1.0:1788748606.376359:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788748607.397567:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748608.296293:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388718976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748608.296367:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748608.296446:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388718976 00000100:00100000:0.0:1788748608.296452:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388718976 00000100:00100000:0.0:1788748608.296490:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788748608.296497:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388718976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788748608.296526:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788748608.296562:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388718976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748608.296569:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788748608.296628:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388718976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748608.296905:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388719104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748608.296938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748608.296978:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388719104 00000100:00100000:3.0:1788748608.296982:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388719104 00000100:00100000:3.0:1788748608.297017:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788748608.297023:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388719104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748608.297041:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788748608.297088:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388719104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748608.297094:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788748608.297111:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748608.297132:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388719104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788748608.297747:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388719232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788748608.297781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748608.297873:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388719232 00000100:00100000:0.0:1788748608.297878:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388719232 00000100:00100000:0.0:1788748608.297912:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788748608.297919:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388719232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788748608.297940:0:17926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788748608.299354:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388719232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1431us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748608.299365:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788748608.304117:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388719232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788748608.424304:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788748608.693152:0:20063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788748608.808553:0:17165:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75569442-d759-49f9-ac7f-46ed0f7f5707 00000001:00100000:0.0:1788748608.808569:0:17165:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 214085a6-5521-4af6-bbcd-d13001081488 00000001:00100000:0.0:1788748608.810165:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 75569442-d759-49f9-ac7f-46ed0f7f5707 00000001:00100000:0.0:1788748608.810179:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 214085a6-5521-4af6-bbcd-d13001081488 00000100:00100000:3.0:1788748609.316823:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388719360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748609.316896:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317066:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388719872:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317093:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317121:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388720384:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317143:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388720896:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317195:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317220:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788748609.317226:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388719488:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317254:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317284:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388720000:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317350:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388720512:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317371:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317596:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388721024:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317623:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317652:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388719744:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317672:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317687:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388720256:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317737:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8add8f163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388720768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317770:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788748609.317776:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388719616:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317798:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317815:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388720128:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317834:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317861:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388720640:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.317894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.317992:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388719360 00000100:00100000:3.0:1788748609.318000:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388719360 00000100:00100000:3.0:1788748609.318052:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748609.318061:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388719360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748609.318084:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788748609.318137:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388719360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748609.318144:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788748609.318192:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388721152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748609.318193:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388719872 00000100:00100000:3.0:1788748609.318202:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388719872 00000100:00100000:3.0:1788748609.318243:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720384 00000100:00100000:3.0:1788748609.318248:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720384 00000100:00100000:3.0:1788748609.318268:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388719744 00000100:00100000:2.0:1788748609.318270:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748609.318273:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388719744 00000100:00100000:3.0:1788748609.318293:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720256 00000100:00100000:3.0:1788748609.318296:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720256 00000100:00100000:3.0:1788748609.318337:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748609.318345:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388719872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.318411:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720896 00000100:00100000:2.0:1788748609.318420:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720896 00000100:00100000:3.0:1788748609.318452:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388719872:12345-0@lo:400:kworker.0 Request processed in 106us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748609.318462:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720000 00000100:00100000:2.0:1788748609.318467:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720000 00000100:00100000:2.0:1788748609.318478:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720512 00000100:00100000:2.0:1788748609.318481:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720512 00000100:00100000:2.0:1788748609.318490:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388721024 00000100:00100000:2.0:1788748609.318493:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388721024 00000100:00100000:2.0:1788748609.318521:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720768 00000100:00100000:2.0:1788748609.318525:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720768 00000100:00100000:2.0:1788748609.318542:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720640 00000100:00100000:2.0:1788748609.318544:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720640 00000100:00100000:2.0:1788748609.318561:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788748609.318570:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388720896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.318579:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788748609.318604:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788748609.318615:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388720384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.318647:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388720896:12345-0@lo:400:kworker.0 Request processed in 64us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748609.318656:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788748609.318666:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388720384:12345-0@lo:400:kworker.0 Request processed in 52us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748609.318675:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788748609.318683:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788748609.318709:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388720000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.318723:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748609.318735:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388719744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.318784:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388719744:12345-0@lo:400:kworker.0 Request processed in 52us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748609.318789:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788748609.318809:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748609.318817:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388720256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.318845:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388720256:12345-0@lo:400:kworker.0 Request processed in 30us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748609.318851:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788748609.318873:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388719488 00000100:00100000:3.0:1788748609.318877:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388719488 00000100:00100000:2.0:1788748609.318972:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388720000:12345-0@lo:400:kworker.0 Request processed in 55us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748609.318981:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788748609.319000:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748609.319008:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388720512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.319051:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875638388720512:12345-0@lo:400:kworker.0 Request processed in 45us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748609.319069:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788748609.319082:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748609.319088:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388721024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.319120:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875638388721024:12345-0@lo:400:kworker.0 Request processed in 32us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748609.319126:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788748609.319138:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788748609.319144:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388720768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.319166:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788748609.319186:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875638388720768:12345-0@lo:400:kworker.0 Request processed in 35us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748609.319187:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3637:x1875638388719488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.319205:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788748609.319227:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788748609.319238:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388720640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.319254:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3637:x1875638388719488:12345-0@lo:400:kworker.0 Request processed in 77us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748609.319262:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788748609.319288:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388720640:12345-0@lo:400:kworker.0 Request processed in 51us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748609.319297:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788748609.319341:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388719616 00000100:00100000:3.0:1788748609.319348:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388719616 00000100:00100000:2.0:1788748609.319363:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388720128 00000100:00100000:2.0:1788748609.319371:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388720128 00000100:00100000:2.0:1788748609.319399:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788748609.319406:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388719616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.319449:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388719616:12345-0@lo:400:kworker.0 Request processed in 40us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748609.319458:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788748609.319538:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388720128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.319581:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388720128:12345-0@lo:400:kworker.0 Request processed in 106us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748609.320363:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388721152 00000100:00100000:1.0:1788748609.320372:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388721152 00000100:00100000:1.0:1788748609.320407:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788748609.320415:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388721152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748609.320444:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788748609.320500:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388721152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748609.320507:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788748609.320534:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788748609.320541:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748609.320544:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748609.320547:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748609.320566:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388721280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748609.320600:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748609.320645:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388719616:0@lo:400:kworker.0 00000100:00100000:1.0:1788748609.320658:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388720128:0@lo:400:kworker.0 00000100:00100000:1.0:1788748609.320670:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388720640:0@lo:400:kworker.0 00000100:00100000:1.0:1788748609.320682:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388719744:0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.323107:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788748609.323299:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788748609.323972:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388720256:0@lo:400:kworker.0 00000100:00100000:2.0:1788748609.324030:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788748609.324064:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388721152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748609.324143:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388721280 00000100:00100000:2.0:1788748609.324153:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388721280 00000100:00100000:2.0:1788748609.324207:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788748609.324216:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388721280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788748609.324243:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788748609.333132:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388719488:0@lo:400:kworker.0 00010000:00080000:1.0:1788748609.333171:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f163800 x1875638388720768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788748609.333179:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388721280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8958us (12572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748609.333196:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788748609.333215:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875638388720768:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.337654:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388720000:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.337695:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875638388720512:0@lo:400:kworker.0 00010000:00080000:3.0:1788748609.337713:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8add8f162a00 x1875638388721024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788748609.337724:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875638388721024:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.337746:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388719360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788748609.337758:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388719872:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.337768:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc825c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388720384:0@lo:400:kworker.0 00000100:00100000:3.0:1788748609.337783:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8add8f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388720896:0@lo:400:kworker.0 00000100:00100000:1.0:1788748609.337857:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388721280:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788748609.380954:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788748609.444822:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748610.468532:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748611.383590:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383630:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383656:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383686:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383705:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383724:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383741:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383762:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748611.383812:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724352 00000100:00100000:2.0:1788748611.384954:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723840 00000100:00100000:2.0:1788748611.384966:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723840 00000100:00100000:1.0:1788748611.385009:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724096 00000100:00100000:1.0:1788748611.385015:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724096 00000100:00100000:2.0:1788748611.385033:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:2.0:1788748611.385048:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:2410:x1875638368723840:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748611.385057:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724608 00000100:00100000:1.0:1788748611.385062:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724608 00000100:00100000:1.0:1788748611.385077:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368723968 00000100:00100000:1.0:1788748611.385081:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368723968 00000100:00100000:1.0:1788748611.385097:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724480 00000100:00100000:1.0:1788748611.385100:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724480 00000100:00100000:1.0:1788748611.385117:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:2.0:1788748611.385124:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:2410:x1875638368723840:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.385128:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+5:2410:x1875638368724096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748611.385138:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:1.0:1788748611.385169:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+5:2410:x1875638368724096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 44us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.385178:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:2.0:1788748611.385186:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1788748611.385196:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2410:x1875638368724608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748611.385202:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1788748611.385213:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:2410:x1875638368723968:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748611.385214:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724352 00000100:00100000:2.0:1788748611.385232:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2410:x1875638368724608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 37us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748611.385240:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1788748611.385261:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1788748611.385263:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724864 00000100:00100000:3.0:1788748611.385268:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724864 00000100:00100000:2.0:1788748611.385275:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368724480:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788748611.385276:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:2410:x1875638368723968:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 61us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748611.385289:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724224 00000100:00100000:1.0:1788748611.385289:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788748611.385294:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724224 00000100:00100000:2.0:1788748611.385310:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368724480:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (1545us total) trans 0 rc 0/0 00000100:00080000:1.0:1788748611.385312:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788748611.385338:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748611.385339:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724736 00000100:00080000:1.0:1788748611.385341:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748611.385345:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724736 00000100:00080000:1.0:1788748611.385347:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748611.385352:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1788748611.385390:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788748611.385399:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:214085a6-5521-4af6-bbcd-d13001081488+5:2410:x1875638368724352:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748611.385406:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1788748611.385437:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:214085a6-5521-4af6-bbcd-d13001081488+5:2410:x1875638368724352:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748611.385514:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add8f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368724864:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788748611.385549:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add8f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368724864:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748611.386616:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788748611.386644:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788748611.386655:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:214085a6-5521-4af6-bbcd-d13001081488+5:2410:x1875638368724224:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748611.386724:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:214085a6-5521-4af6-bbcd-d13001081488+5:2410:x1875638368724224:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 72us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748611.386732:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788748611.386751:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1788748611.386761:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368724736:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748611.386792:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368724736:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748611.386799:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788748611.390353:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:0.0:1788748611.395166:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788748611.492498:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788748611.687157:0:20210:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7b2ffe10 20000000:00000080:0.0:1788748611.687176:0:20210:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8add85948000 uarg=0000000000000000 20000000:01000000:0.0:1788748611.687214:0:20210:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788748611.687219:0:20210:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788748611.687224:0:20210:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788748611.688138:0:20211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788748611.688310:0:20210:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788748611.699229:0:20210:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788748611.699259:0:20210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699278:0:20210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699286:0:20210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699293:0:20210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 23 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699300:0:20210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699311:0:20210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699583:0:20210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699608:0:20210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699790:0:20210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 12 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699808:0:20210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 12 pid: 17177 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.699823:0:20210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721408:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748611.699975:0:20210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.699985:0:20210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 12 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.699994:0:20210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721536:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748611.700026:0:20210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.700035:0:20210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 23 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.700050:0:20210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721664:0@lo:104: 00000100:00100000:0.0:1788748611.700090:0:20210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748611.700137:0:20210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 23 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.700156:0:20210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 23 pid: 17180 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.700164:0:20210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721792:0@lo:104: 00000100:00100000:0.0:1788748611.700187:0:20210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748611.700212:0:20210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.700220:0:20210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 23 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.700228:0:20210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721920:0@lo:104: 00000100:00100000:0.0:1788748611.700248:0:20210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788748611.700265:0:20210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.700273:0:20210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 23 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.700281:0:20210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388722048:0@lo:104: 00000100:00100000:0.0:1788748611.700300:0:20210:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748611.700310:0:20210:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82dae900 going to sleep for 11 seconds 00000100:00100000:1.0:1788748611.700418:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388721664 00000100:00100000:1.0:1788748611.700433:0:17169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388721664 00000100:00100000:1.0:1788748611.700472:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388721792 00000100:00100000:1.0:1788748611.700475:0:17169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388721792 00000100:00100000:1.0:1788748611.700497:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388721920 00000100:00100000:1.0:1788748611.700500:0:17169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388721920 00000100:00100000:1.0:1788748611.700512:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722048 00000100:00100000:1.0:1788748611.700515:0:17169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722048 00000100:00100000:1.0:1788748611.700529:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748611.700538:0:17169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+6:20210:x1875638388721664:12345-0@lo:104: 00010000:00010000:1.0:1788748611.700550:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700619:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788748611.700626:0:17169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+6:20210:x1875638388721664:12345-0@lo:104: Request processed in 90us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.700632:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748611.700659:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748611.700665:0:17169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+5:20210:x1875638388721792:12345-0@lo:104: 00010000:00010000:1.0:1788748611.700682:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700715:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788748611.700720:0:17169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+5:20210:x1875638388721792:12345-0@lo:104: Request processed in 56us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.700726:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748611.700738:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748611.700744:0:17169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:20210:x1875638388721920:12345-0@lo:104: 00010000:00010000:1.0:1788748611.700751:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700790:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788748611.700795:0:17169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+4:20210:x1875638388721920:12345-0@lo:104: Request processed in 52us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.700801:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748611.700814:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748611.700820:0:17169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:20210:x1875638388722048:12345-0@lo:104: 00010000:00010000:1.0:1788748611.700827:0:17169:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700852:0:17169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788748611.700857:0:17169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f35c4edf-1df7-4d0c-8881-06ee23716a92+3:20210:x1875638388722048:12345-0@lo:104: Request processed in 39us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.700862:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788748611.700878:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788748611.700884:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700891:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add912bc400 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748611.700895:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700904:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748611.700911:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748611.700917:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748611.700954:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700961:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748611.700983:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.700990:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add912bc400/0x9ba0f20a02e1b368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b36f expref: -99 pid: 19504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701005:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788748611.701007:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701013:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add95d76200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748611.701015:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701021:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748611.701027:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748611.701031:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748611.701043:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701049:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748611.701055:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701071:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8add95d76200/0x9ba0f20a02e1b2ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b2d5 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701082:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788748611.701085:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701091:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940600 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748611.701094:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701100:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748611.701106:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748611.701111:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748611.701124:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701130:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748611.701147:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701153:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940600/0x9ba0f20a02e1b28f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b296 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701162:0:17174:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748611.701171:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701176:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940200 already unused, calling callback (ffffffffc130bc20) 10000000:00010000:1.0:1788748611.701179:0:17174:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701186:0:17174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788748611.701192:0:17174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748611.701197:0:17174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788748611.701210:0:17174:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701215:0:17174:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788748611.701222:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701228:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff8addbc940200/0x9ba0f20a02e1b281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ba0f20a02e1b288 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.701241:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748611.701243:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748611.701245:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748611.701252:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788748611.701273:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388722176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748611.701304:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748611.701374:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788748611.701380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388722304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748611.701408:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748611.701435:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388722560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748611.702208:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748611.702234:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788748611.702240:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388722432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748611.702261:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748611.702288:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722176 00000100:00100000:1.0:1788748611.702293:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722176 00010000:00010000:1.0:1788748611.702343:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 24 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748611.702371:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722304 00000100:00100000:1.0:1788748611.702375:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722304 00010000:00010000:1.0:1788748611.702388:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 25 pid: 17180 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748611.702404:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722560 00000100:00100000:1.0:1788748611.702406:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722560 00010000:00010000:1.0:1788748611.702417:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 26 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748611.702426:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722432 00000100:00100000:1.0:1788748611.702429:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722432 00010000:00010000:1.0:1788748611.702438:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 27 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748611.702451:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748611.702457:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+27:3637:x1875638388722176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748611.702480:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748611.702494:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 27 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.702504:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 27 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.702521:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748611.702555:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+27:3637:x1875638388722176:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (1250us total) trans 0 rc 0/0 00010000:00010000:0.0:1788748611.702715:0:20210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc83a69000/0x9ba0f20a02e1b36f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b368 expref: 27 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.702727:0:20210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721664:0@lo:104: 00000100:00100000:0.0:1788748611.702736:0:20210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721792:0@lo:104: 00000100:00100000:0.0:1788748611.702743:0:20210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721920:0@lo:104: 00000100:00100000:0.0:1788748611.702760:0:20210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388722048:0@lo:104: 00000100:00100000:1.0:1788748611.702974:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788748611.702995:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748611.703002:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+25:3637:x1875638388722304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748611.703011:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748611.703015:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 25 pid: 17180 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703023:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 25 pid: 17180 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703033:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add912bd600/0x9ba0f20a02e1b2d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b2ce expref: 25 pid: 17180 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703042:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748611.703070:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3637:x1875638388722304:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.703076:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788748611.703089:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748611.703095:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:3636:x1875638388722560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748611.703110:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748611.703115:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 23 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703123:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 23 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703132:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8adc83a68600/0x9ba0f20a02e1b288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b281 expref: 23 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703140:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748611.703178:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:3636:x1875638388722560:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.703184:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788748611.703198:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748611.703204:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:3636:x1875638388722432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788748611.703211:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748611.703215:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 21 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703223:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 21 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703232:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8add95d76a00/0x9ba0f20a02e1b296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ba0f20a02e1b28f expref: 21 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.703241:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748611.703261:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:3636:x1875638388722432:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748611.703278:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788748611.703341:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388722304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788748611.703352:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f35c4edf-1df7-4d0c-8881-06ee23716a92:3637:1875638388722176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748611.703691:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388722432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788748611.703700:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388722560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788748611.719596:0:20210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721408:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748611.719612:0:20210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20210:1875638388721536:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748611.719659:0:20210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748611.724421:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748611.724489:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748611.724609:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368724992 00000100:00100000:2.0:1788748611.724619:0:17172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368724992 00000100:00100000:1.0:1788748611.724730:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368725120 00000100:00100000:1.0:1788748611.724735:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368725120 00010000:00010000:1.0:1788748611.724764:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 14 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748611.724782:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 14 pid: 17177 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748611.724802:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:2.0:1788748611.724811:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1788748611.724816:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5c63e85-f7a2-441c-9884-b3ba050117ac+14:2411:x1875638368725120:12345-192.168.203.22@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788748611.724825:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5c63e85-f7a2-441c-9884-b3ba050117ac+14:2411:x1875638368724992:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748611.724830:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788748611.724836:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748611.724838:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 14 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748611.724845:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 14 pid: 17177 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.724854:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 14 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748611.733216:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 14 pid: 17177 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748611.733748:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b5c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4022 expref: 14 pid: 17177 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748611.733768:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748611.734564:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:2411:x1875638368724992:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 9737us (10145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748611.734576:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00010000:00010000:1.0:1788748611.737002:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addb3bbb800/0x9ba0f20a02e1b583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fb2 expref: 12 pid: 17179 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.737535:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748611.737548:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740653:0:17170:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740682:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740690:0:17170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740699:0:17170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740706:0:17170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc941c00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748611.740710:0:17170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740719:0:17170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740738:0:17170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748611.740752:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748611.740829:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:2411:x1875638368725120:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 16013us (16334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748611.740858:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00010000:00010000:3.0:1788748611.741776:0:20210:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748611.741798:0:20210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748611.741805:0:20210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8addbc941c00/0x9ba0f20a02e1b5f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788748611.878749:0:19505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75569442-d759-49f9-ac7f-46ed0f7f5707 00000001:00100000:0.0:1788748611.884019:0:18687:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75569442-d759-49f9-ac7f-46ed0f7f5707 00010000:00010000:3.0:1788748612.519263:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748612.806185:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748612.806275:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368725248 00000100:00100000:3.0:1788748612.806285:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368725248 00000100:00100000:3.0:1788748612.806428:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:3.0:1788748612.806440:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+11:14912:x1875638368725248:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748612.806457:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748612.806476:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addb3bba000/0x9ba0f20a02e1b5fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa405a expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748612.806505:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addb3bba000/0x9ba0f20a02e1b5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa405a expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748612.806517:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addb3bba000/0x9ba0f20a02e1b5fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa405a expref: 12 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748612.806525:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bba000, rc 0) 00000100:00100000:3.0:1788748612.806582:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:14912:x1875638368725248:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 145us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748612.806589:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:1.0:1788748612.812195:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748612.812381:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368725376 00000100:00100000:3.0:1788748612.812397:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368725376 00000100:00100000:3.0:1788748612.812450:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:3.0:1788748612.812461:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:14912:x1875638368725376:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748612.812611:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:14912:x1875638368725376:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 151us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748612.812620:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:0.0:1788748612.819826:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748612.821482:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368725504 00000100:00100000:2.0:1788748612.821496:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368725504 00000100:00100000:2.0:1788748612.821560:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:2.0:1788748612.821570:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:14912:x1875638368725504:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748612.821716:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:14912:x1875638368725504:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 147us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748612.821724:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:1.0:1788748612.828829:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748612.829605:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368725632 00000100:00100000:0.0:1788748612.829616:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368725632 00000100:00100000:0.0:1788748612.829688:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:0.0:1788748612.829699:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+12:14912:x1875638368725632:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748612.829718:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748612.829736:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc941a00/0x9ba0f20a02e1b601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4061 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748612.829765:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc941a00/0x9ba0f20a02e1b601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4061 expref: 13 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748612.829777:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc941a00/0x9ba0f20a02e1b601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4061 expref: 13 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748612.829787:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc941a00, rc 0) 00000100:00100000:0.0:1788748612.829845:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:14912:x1875638368725632:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 148us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748612.829869:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:0.0:1788748612.833821:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748612.833883:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368725760 00000100:00100000:1.0:1788748612.833893:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368725760 00000100:00100000:1.0:1788748612.833945:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:1.0:1788748612.833954:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:14912:x1875638368725760:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748612.834090:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:14912:x1875638368725760:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 137us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748612.834098:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:0.0:1788748612.839009:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748612.839466:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368725888 00000100:00100000:1.0:1788748612.839476:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368725888 00000100:00100000:1.0:1788748612.839523:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:1.0:1788748612.839534:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:14912:x1875638368725888:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748612.839680:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:14912:x1875638368725888:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 135us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748612.839688:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 152 10000000:01000000:3.0:1788748613.030364:0:17182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788748613.030373:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc8256d800 from 13 10000000:01000000:3.0:1788748613.030378:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788748613.030427:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1b608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748613.030449:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1b608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748613.030460:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1b608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748613.030485:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388722688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788748613.030552:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748613.030594:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748613.031568:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722688 00000100:00100000:1.0:1788748613.031578:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722688 00000100:00100000:1.0:1788748613.031626:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788748613.031635:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+20:17182:x1875638388722688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788748613.031650:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748613.031678:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b60f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b608 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748613.031715:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b60f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b608 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748613.031726:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adc83a68000/0x9ba0f20a02e1b60f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b608 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748613.031748:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68000, rc 0) 00000100:00100000:1.0:1788748613.031808:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388722688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748613.031815:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788748613.032574:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388722688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788748613.032594:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1b608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b60f expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748613.032605:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1b608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b60f expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748613.032691:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388722816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748613.032742:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748613.032831:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748613.040858:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722816 00000100:00100000:1.0:1788748613.040874:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722816 00000100:00100000:1.0:1788748613.040940:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788748613.040950:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388722816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748613.041584:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388722816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 633us (8839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748613.041593:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788748613.041915:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388722816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788748613.042089:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388722944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748613.042142:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748613.042188:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc83b210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788748613.042237:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388722944 00000100:00100000:1.0:1788748613.042242:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388722944 00000100:00100000:1.0:1788748613.042292:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788748613.042300:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388722944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788748613.043799:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388722944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1494us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748613.043809:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788748613.048024:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388722944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788748613.049312:0:20264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788748613.049533:0:17182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788748613.049558:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788748613.049569:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1b608 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b60f expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748613.049580:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addb3bbb000/0x9ba0f20a02e1b608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b60f expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788748613.049602:0:17182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788748613.049604:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add84308800 from 13 10000000:01000000:1.0:1788748613.049607:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788748613.049638:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748613.049646:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748613.049656:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748613.049691:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788748613.049754:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748613.049796:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5066480 going to sleep for 11 seconds 00000100:00100000:0.0:1788748613.049875:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723072 00000100:00100000:0.0:1788748613.049883:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723072 00000100:00100000:0.0:1788748613.049923:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788748613.049941:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+21:17182:x1875638388723072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748613.049954:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748613.049966:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b61d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b616 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.049991:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b616 expref: 22 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.050001:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940600/0x9ba0f20a02e1b61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b616 expref: 22 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.050010:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940600, rc 0) 00000100:00100000:0.0:1788748613.050064:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:17182:x1875638388723072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748613.050071:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788748613.050635:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748613.050650:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b61d expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.050659:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b61d expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748613.050727:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.050757:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748613.050781:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788748613.050832:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723200 00000100:00100000:1.0:1788748613.050838:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723200 00000100:00100000:1.0:1788748613.050888:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788748613.050897:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:17182:x1875638388723200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788748613.051013:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:17182:x1875638388723200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748613.051021:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788748613.053625:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.053703:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.053774:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748613.053823:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723328 00000100:00100000:2.0:1788748613.053830:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723328 00000100:00100000:2.0:1788748613.053888:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788748613.053897:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:17182:x1875638388723328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.053993:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:17182:x1875638388723328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748613.054001:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788748613.054085:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748613.054121:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788748613.057822:0:20266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788748613.058076:0:17182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788748613.058533:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748613.058545:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b616 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b61d expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.058559:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adc83a69c00/0x9ba0f20a02e1b616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b61d expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788748613.058570:0:17182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788748613.058573:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8add913f3000 from 13 10000000:01000000:0.0:1788748613.058576:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788748613.058613:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e1b624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.058622:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e1b624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.058643:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e1b624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748613.058682:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788748613.058746:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748613.058838:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82daee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748613.059513:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723456 00000100:00100000:2.0:1788748613.059677:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723456 00000100:00100000:2.0:1788748613.059731:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788748613.059741:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+22:17182:x1875638388723456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748613.059755:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748613.059769:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8adda73fe000/0x9ba0f20a02e1b62b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b624 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.059794:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8adda73fe000/0x9ba0f20a02e1b62b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b624 expref: 23 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.059805:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8adda73fe000/0x9ba0f20a02e1b62b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b624 expref: 23 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.059813:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73fe000, rc 0) 00000100:00100000:2.0:1788748613.059919:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388723456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748613.059926:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788748613.059995:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748613.060013:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e1b624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b62b expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.060022:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e1b624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b62b expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748613.060088:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748613.060826:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748613.060899:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82daee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748613.060940:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723584 00000100:00100000:2.0:1788748613.060946:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723584 00000100:00100000:2.0:1788748613.061025:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788748613.061035:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388723584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.061168:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388723584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748613.061175:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788748613.061260:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748613.061292:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748613.061345:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748613.061958:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723712 00000100:00100000:3.0:1788748613.061964:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723712 00000100:00100000:3.0:1788748613.061993:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788748613.062001:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388723712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788748613.062093:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388723712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748613.062111:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788748613.062651:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8adc82daee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748613.062680:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788748613.071421:0:20268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788748613.071745:0:17182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788748613.071769:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788748613.071780:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e1b624 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b62b expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.071793:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8addbc941c00/0x9ba0f20a02e1b624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b62b expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788748613.071803:0:17182:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788748613.071806:0:17182:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8adc848d0800 from 13 10000000:01000000:2.0:1788748613.071809:0:17182:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788748613.071844:0:17182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adda73fe200/0x9ba0f20a02e1b632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.071851:0:17182:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff8adda73fe200/0x9ba0f20a02e1b632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.071862:0:17182:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff8adda73fe200/0x9ba0f20a02e1b632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748613.071887:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.071951:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748613.072003:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748613.075246:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723840 00000100:00100000:0.0:1788748613.075270:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723840 00000100:00100000:0.0:1788748613.075360:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788748613.075370:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+23:17182:x1875638388723840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788748613.075386:0:17180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748613.075404:0:17180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ba0f20a02e1b632 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.075431:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b632 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.075453:0:17180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8addbc940000/0x9ba0f20a02e1b639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ba0f20a02e1b632 expref: 24 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.075461:0:17180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940000, rc 0) 00000100:00100000:0.0:1788748613.075524:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388723840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (3573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748613.075531:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788748613.075989:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788748613.076007:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff8adda73fe200/0x9ba0f20a02e1b632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b639 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748613.076018:0:17182:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff8adda73fe200/0x9ba0f20a02e1b632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ba0f20a02e1b639 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748613.076118:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.076157:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748613.076196:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748613.076545:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388723968 00000100:00100000:0.0:1788748613.076551:0:17177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388723968 00000100:00100000:0.0:1788748613.076582:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788748613.076589:0:17177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb5377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388723968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788748613.076707:0:17177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb5377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388723968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748613.076714:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788748613.076821:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388723968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.076854:0:17182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388724096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788748613.076897:0:17182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748613.076930:0:17182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addba6079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748613.077197:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724096 00000100:00100000:0.0:1788748613.077202:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724096 00000100:00100000:0.0:1788748613.077981:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788748613.077995:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388724096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788748613.078141:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:17182:x1875638388724096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748613.078158:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788748613.085418:0:17182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f35c4edf-1df7-4d0c-8881-06ee23716a92:17182:1875638388724096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788748613.087490:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788748613.095973:0:17182:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788748613.096011:0:17182:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788748613.096023:0:17182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff8adda73fe200/0x9ba0f20a02e1b632 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b639 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748613.096035:0:17182:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff8adda73fe200/0x9ba0f20a02e1b632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ba0f20a02e1b639 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748613.414426:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388724224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788748613.414493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748613.416994:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724224 00000100:00100000:2.0:1788748613.417009:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724224 00000100:00100000:2.0:1788748613.417086:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788748613.417097:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388724224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788748613.417135:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788748613.417220:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388724224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748613.417226:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788748613.417493:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addb533ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388724224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748613.423085:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748613.423105:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388724480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748613.423172:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748613.423219:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724480 00000100:00100000:2.0:1788748613.423225:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724480 00000100:00100000:2.0:1788748613.423264:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788748613.423272:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388724480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788748613.423313:0:17926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788748613.424800:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388724480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1521us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748613.424812:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788748613.424900:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388724480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748613.425914:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388724352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788748613.425983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748613.426241:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724352 00000100:00100000:1.0:1788748613.426249:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724352 00000100:00100000:1.0:1788748613.426350:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788748613.426476:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388724352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788748613.426508:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788748613.426644:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748613.426707:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388724352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 235us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748613.426962:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388724352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748613.434121:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1788748613.540504:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788748614.436562:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388724608:0@lo:400:kworker.0 00000100:00100000:0.0:1788748614.436638:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748614.436645:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388724736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788748614.436689:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748614.436716:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748614.436723:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc8493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388724864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788748614.436921:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748614.436957:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724608 00000100:00100000:2.0:1788748614.436965:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724608 00000100:00100000:2.0:1788748614.437008:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788748614.437018:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3636:x1875638388724608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748614.438458:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388725120:0@lo:400:kworker.0 00000100:00100000:0.0:1788748614.438517:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748614.438724:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724736 00000100:00100000:1.0:1788748614.438748:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724736 00000100:00100000:1.0:1788748614.438794:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724864 00000100:00100000:1.0:1788748614.438797:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724864 00000100:00100000:1.0:1788748614.438811:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748614.438819:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388724736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788748614.438841:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788748614.438889:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388724736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.438896:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788748614.438913:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748614.438920:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388724864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788748614.438937:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788748614.438963:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388724864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.438969:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788748614.439012:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc8493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388724864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748614.439027:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388724736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788748614.439061:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388725120 00000100:00100000:1.0:1788748614.439065:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388725120 00000100:00100000:1.0:1788748614.439091:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788748614.439098:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388725120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.439153:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388725120:12345-0@lo:400:kworker.0 Request processed in 55us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.439159:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788748614.439189:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788748614.439193:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788748614.439224:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388724992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748614.439254:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748614.439282:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388724992 00000100:00100000:1.0:1788748614.439299:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388724992 00000100:00100000:1.0:1788748614.439344:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788748614.439351:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388724992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788748614.439361:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788748614.439390:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388724992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.439396:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788748614.439410:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788748614.439428:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388724992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788748614.444745:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3636:x1875638388724608:12345-0@lo:400:kworker.0 Request processed in 7718us (8096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748614.444761:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788748614.446590:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f35c4edf-1df7-4d0c-8881-06ee23716a92:3636:1875638388724608:0@lo:400:kworker.0 00000100:00100000:0.0:1788748614.446633:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388725120:0@lo:400:kworker.0 00000100:00100000:2.0:1788748614.452735:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388725248:0@lo:400:kworker.0 00000100:00100000:2.0:1788748614.453515:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748614.453555:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788748614.453562:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388725376:0@lo:400:kworker.0 00000100:00100000:2.0:1788748614.453611:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748614.453650:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388725376 00000100:00100000:2.0:1788748614.453666:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388725376 00000100:00100000:2.0:1788748614.453711:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788748614.453720:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388725376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748614.453772:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388725376:12345-0@lo:400:kworker.0 Request processed in 52us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748614.453779:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788748614.453987:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388725504:0@lo:400:kworker.0 00000100:00100000:0.0:1788748614.454456:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388725888:0@lo:400:kworker.0 00000100:00100000:0.0:1788748614.454494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748614.454522:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748614.454528:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388725760:0@lo:400:kworker.0 00000100:00100000:0.0:1788748614.454549:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748614.454620:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388725248 00000100:00100000:1.0:1788748614.454626:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388725248 00000100:00100000:1.0:1788748614.454669:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388725888 00000100:00100000:1.0:1788748614.454672:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388725888 00000100:00100000:1.0:1788748614.454693:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388725760 00000100:00100000:1.0:1788748614.454696:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388725760 00000100:00100000:1.0:1788748614.454709:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788748614.454721:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388725248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.454764:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875638388725248:12345-0@lo:400:kworker.0 Request processed in 44us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.454784:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788748614.454957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748614.454979:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388726016:0@lo:400:kworker.0 00000100:00100000:3.0:1788748614.455001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748614.455517:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788748614.455526:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388725632:0@lo:400:kworker.0 00000100:00100000:3.0:1788748614.455553:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748614.455566:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388726144:0@lo:400:kworker.0 00000100:00100000:3.0:1788748614.455584:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748614.455618:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388725504 00000100:00100000:3.0:1788748614.455622:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388725504 00000100:00100000:3.0:1788748614.455669:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748614.455676:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388725504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748614.455719:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388725504:12345-0@lo:400:kworker.0 Request processed in 43us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748614.455726:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788748614.455768:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388725504:0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.455873:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388726016 00000100:00100000:1.0:1788748614.455878:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388726016 00000100:00100000:1.0:1788748614.455896:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388725632 00000100:00100000:1.0:1788748614.455898:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388725632 00000100:00100000:1.0:1788748614.455908:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388726144 00000100:00100000:1.0:1788748614.455911:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388726144 00000100:00100000:1.0:1788748614.455925:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748614.455931:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388725888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.455976:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875638388725888:12345-0@lo:400:kworker.0 Request processed in 45us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.455982:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788748614.455995:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748614.456002:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388725760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.456045:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875638388725760:12345-0@lo:400:kworker.0 Request processed in 44us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.456052:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748614.456062:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748614.456068:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388726016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.456099:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875638388726016:12345-0@lo:400:kworker.0 Request processed in 32us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.456105:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788748614.456116:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748614.456122:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388725632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.456160:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388725632:12345-0@lo:400:kworker.0 Request processed in 39us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.456176:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788748614.456189:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788748614.456195:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388726144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.456237:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388726144:12345-0@lo:400:kworker.0 Request processed in 42us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748614.456243:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788748614.456259:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748614.456263:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788748614.456278:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388725632:0@lo:400:kworker.0 00010000:00080000:1.0:1788748614.456289:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bd8e00 x1875638388726144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748614.456298:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388726144:0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.456306:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875638388726016:0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.456380:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875638388725760:0@lo:400:kworker.0 00010000:00080000:1.0:1788748614.456392:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bda300 x1875638388725888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748614.456401:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875638388725888:0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.459635:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388725376:0@lo:400:kworker.0 00000100:00100000:1.0:1788748614.459666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875638388725248:0@lo:400:kworker.0 00010000:00010000:3.0:1788748614.564472:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748615.123489:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.123608:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368726016 00000100:00100000:1.0:1788748615.123617:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368726016 00000100:00100000:1.0:1788748615.123714:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1788748615.123743:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+6:15581:x1875638368726016:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748615.123765:0:18714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748615.123790:0:18714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4068 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.123870:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.123884:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.123898:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.123911:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.123918:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.123928:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124031:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1b655 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124040:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1b655 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124052:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1b655 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748615.124091:0:18714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788748615.124095:0:18714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748615.124133:0:18714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1b655 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124144:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124150:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124157:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124163:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748615.124167:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124174:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124186:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:1.0:1788748615.124189:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.124193:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124199:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124213:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124229:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124236:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124242:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748615.124252:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124259:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124268:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8add91e32d00) 00010000:00010000:1.0:1788748615.124271:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.124274:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124279:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b64e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124377:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4068 expref: 8 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124397:0:18714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69800/0x9ba0f20a02e1b655 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4068 expref: 7 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.124403:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:1.0:1788748615.124406:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748615.124414:0:18714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69800, rc 0) 00000100:00100000:1.0:1788748615.124473:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+7:15581:x1875638368726016:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 733us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.124480:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00080000:2.0:1788748615.125236:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748615.128311:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.128681:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368726144 00000100:00100000:1.0:1788748615.128689:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368726144 00000100:00100000:1.0:1788748615.128750:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1788748615.128760:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:214085a6-5521-4af6-bbcd-d13001081488+7:15581:x1875638368726144:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788748615.128845:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:214085a6-5521-4af6-bbcd-d13001081488+7:15581:x1875638368726144:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 87us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.128854:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1788748615.136626:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.136817:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368726400 00000100:00100000:1.0:1788748615.136829:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368726400 00000100:00100000:1.0:1788748615.136894:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1788748615.136905:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+7:15581:x1875638368726400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748615.136925:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748615.136945:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b65c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa406f expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137019:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137034:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137046:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137105:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137120:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137129:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137236:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1b671 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137245:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1b671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137512:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1b671 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748615.137523:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788748615.137675:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137683:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137690:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137696:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748615.137700:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137706:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137728:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8add91e32f00) 00010000:00010000:1.0:1788748615.137731:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.137736:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137743:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b663 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137755:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137761:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137767:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137772:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748615.137775:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137781:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137789:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8add91e32d00) 00010000:00010000:1.0:1788748615.137791:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.137794:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.137800:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b66a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.138823:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b65c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa406f expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.138845:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68400/0x9ba0f20a02e1b671 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa406f expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.138852:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8add91e32200) 00010000:00010000:1.0:1788748615.138854:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.138856:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68400, rc 0) 00000100:00100000:1.0:1788748615.139042:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+9:15581:x1875638368726400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2138us (2623us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788748615.139050:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788748615.150511:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.150731:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368726528 00000100:00100000:1.0:1788748615.150741:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368726528 00000100:00100000:1.0:1788748615.150793:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:1.0:1788748615.150804:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+9:15581:x1875638368726528:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788748615.150909:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+9:15581:x1875638368726528:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 106us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.150916:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788748615.152520:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.152592:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368726656 00000100:00100000:2.0:1788748615.152600:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368726656 00000100:00100000:2.0:1788748615.152874:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:2.0:1788748615.152894:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+5:15581:x1875638368726656:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788748615.153528:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788748615.153684:0:17185:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 723us 00000100:00100000:0.0:1788748615.179689:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+5:15581:x1875638368726656:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 26790us (27165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748615.179702:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1788748615.221160:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.221372:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368726784 00000100:00100000:1.0:1788748615.221382:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368726784 00000100:00100000:1.0:1788748615.221632:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1788748615.221642:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+9:15587:x1875638368726784:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748615.221672:0:18714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748615.221702:0:18714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b67f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4076 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221773:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221788:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221800:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221814:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221820:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221826:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221866:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221872:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221879:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221885:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748615.221889:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221907:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221918:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:1.0:1788748615.221921:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.221926:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221931:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221944:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221950:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221955:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221960:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748615.221963:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221968:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221974:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8add91e32d00) 00010000:00010000:1.0:1788748615.221976:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.221979:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.221993:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b68d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.222023:0:18714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b67f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4076 expref: 10 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.222032:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:1.0:1788748615.222034:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.222037:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b67f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4076 expref: 10 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.222045:0:18714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68600, rc 0) 00000100:00100000:1.0:1788748615.222296:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+9:15587:x1875638368726784:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 654us (1145us total) trans 0 rc 301/301 00000100:00100000:1.0:1788748615.222303:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1788748615.230425:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.230860:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368726912 00000100:00100000:2.0:1788748615.230872:0:17194:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368726912 00000100:00100000:2.0:1788748615.230926:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1788748615.230936:0:17194:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:214085a6-5521-4af6-bbcd-d13001081488+9:15587:x1875638368726912:12345-192.168.203.22@tcp:700:lfs.0 00000100:00100000:2.0:1788748615.231024:0:17194:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:214085a6-5521-4af6-bbcd-d13001081488+9:15587:x1875638368726912:12345-192.168.203.22@tcp:700:lfs.0 Request processed in 82us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748615.231032:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1788748615.233869:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.233954:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368727168 00000100:00100000:1.0:1788748615.233964:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368727168 00000100:00100000:1.0:1788748615.234018:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1788748615.234028:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+9:15587:x1875638368727168:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:1.0:1788748615.234127:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748615.234155:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b5ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa3fe3 expref: 9 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.234174:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:1.0:1788748615.234179:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748615.234231:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.234258:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 5 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.234266:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.234297:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 5 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.234309:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 5 pid: 17185 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748615.234629:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17186:1875638388726272:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748615.234728:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb5066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788748615.238180:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748615.238247:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368727296 00000100:00100000:3.0:1788748615.238256:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368727296 00010000:00010000:3.0:1788748615.238338:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 6 pid: 17185 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748615.238396:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1788748615.238406:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368727296:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748615.238420:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748615.238427:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 6 pid: 17185 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788748615.238680:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788748615.238716:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 6 pid: 17185 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.238741:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:3.0:1788748615.238760:0:17171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.238770:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.238777:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.238800:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748615.238858:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:2410:x1875638368727296:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 453us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748615.238875:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00010000:00010000:1.0:1788748615.240670:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b5ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4053 expref: 5 pid: 17185 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748615.240702:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17186:1875638388726272:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748615.240726:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.240737:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.240743:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.240769:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.240792:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.240802:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243037:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243058:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243069:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748615.243085:0:17186:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000e17c6df reply state 00000000b9f56e00 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243097:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243104:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:1.0:1788748615.243108:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748615.243111:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788748615.243116:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788748615.243124:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243131:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243138:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243151:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748615.243155:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243163:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243173:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8adc8259a100) 00010000:00010000:1.0:1788748615.243175:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788748615.243179:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243185:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b694 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748615.243202:0:17186:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000e17c6df reply state 00000000b9f56e00 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243210:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.243215:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8add91e32d00) 00010000:00010000:1.0:1788748615.243218:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748615.243220:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788748615.244023:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+10:15587:x1875638368727168:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 9990us (10157us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788748615.244034:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:0.0:1788748615.355785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748615.355862:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368727424 00000100:00100000:3.0:1788748615.355872:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368727424 00000100:00100000:3.0:1788748615.355921:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1788748615.355928:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+10:15595:x1875638368727424:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:3.0:1788748615.355948:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748615.355967:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba800/0x9ba0f20a02e1b6a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa407d expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.356017:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb400/0x9ba0f20a02e1b6b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.356028:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb400/0x9ba0f20a02e1b6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.356037:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb400/0x9ba0f20a02e1b6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748615.356076:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788748615.356088:0:17184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748615.356119:0:17184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb400/0x9ba0f20a02e1b6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.356136:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba800/0x9ba0f20a02e1b6a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa407d expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.356150:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbb400/0x9ba0f20a02e1b6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa407d expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.356155:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:3.0:1788748615.356157:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748615.356160:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbb400, rc 0) 00000100:00100000:3.0:1788748615.356236:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+11:15595:x1875638368727424:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 309us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748615.356241:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1788748615.389718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.389992:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368727552 00000100:00100000:2.0:1788748615.390002:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368727552 00000100:00100000:2.0:1788748615.390062:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1788748615.390072:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+5:15596:x1875638368727552:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748615.390102:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748615.390140:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b6b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4084 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.390202:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffa00/0x9ba0f20a02e1b6be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.390215:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffa00/0x9ba0f20a02e1b6be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.390228:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffa00/0x9ba0f20a02e1b6be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748615.390270:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788748615.390274:0:17185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748615.390293:0:17185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffa00/0x9ba0f20a02e1b6be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.390348:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b6b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4084 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.390369:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffa00/0x9ba0f20a02e1b6be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4084 expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.390377:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:2.0:1788748615.390380:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788748615.390384:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73ffa00, rc 0) 00000100:00100000:2.0:1788748615.390440:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15596:x1875638368727552:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 371us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748615.390447:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1788748615.396777:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748615.396843:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368727680 00000100:00100000:3.0:1788748615.396854:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368727680 00000100:00100000:3.0:1788748615.396954:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:3.0:1788748615.396966:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+6:15596:x1875638368727680:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788748615.396986:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748615.397007:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba800/0x9ba0f20a02e1b6c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa408b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397072:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397086:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397115:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397127:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397134:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397141:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397213:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1b6da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397220:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1b6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397227:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1b6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788748615.397264:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788748615.397268:0:17184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788748615.397290:0:17184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1b6da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397302:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397308:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397347:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397354:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bba600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748615.397358:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397366:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397377:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:3.0:1788748615.397380:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748615.397386:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397392:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba600/0x9ba0f20a02e1b6cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397406:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397413:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397424:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397429:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbaa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:3.0:1788748615.397432:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397449:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397457:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8add91e32d00) 00010000:00010000:3.0:1788748615.397459:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788748615.397462:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397468:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b6d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397495:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba800/0x9ba0f20a02e1b6c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa408b expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397508:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1b6da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa408b expref: 7 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.397514:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:3.0:1788748615.397517:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788748615.397519:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addb3bbbe00, rc 0) 00000100:00100000:3.0:1788748615.397583:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+7:15596:x1875638368727680:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 619us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748615.397591:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788748615.403474:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.404676:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368727808 00000100:00100000:1.0:1788748615.404692:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368727808 00000100:00080000:2.0:1788748615.404763:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788748615.404776:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1788748615.404792:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc8407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75569442-d759-49f9-ac7f-46ed0f7f5707+5:15596:x1875638368727808:12345-192.168.203.22@tcp:900:lfs.0 00000100:00100000:1.0:1788748615.404877:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc8407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:75569442-d759-49f9-ac7f-46ed0f7f5707+5:15596:x1875638368727808:12345-192.168.203.22@tcp:900:lfs.0 Request processed in 87us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.404884:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:0.0:1788748615.409176:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.409288:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368728064 00000100:00100000:2.0:1788748615.409299:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368728064 00000100:00100000:1.0:1788748615.409702:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1788748615.409715:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+7:15596:x1875638368728064:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748615.409736:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748615.409757:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4092 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748615.409857:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788748615.409952:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4092 expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.409966:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:1.0:1788748615.409969:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748615.409974:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4092 expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.409988:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68600, rc 0) 00000100:00100000:1.0:1788748615.410980:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75569442-d759-49f9-ac7f-46ed0f7f5707+8:15596:x1875638368728064:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1263us (1808us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788748615.410990:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1788748615.415694:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.418603:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368728320 00000100:00100000:1.0:1788748615.418615:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368728320 00000100:00100000:1.0:1788748615.418694:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1788748615.418705:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75569442-d759-49f9-ac7f-46ed0f7f5707+8:15596:x1875638368728320:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:1.0:1788748615.418768:0:18714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748615.418793:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbbe00/0x9ba0f20a02e1b6da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa408b expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.418812:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:1.0:1788748615.418816:0:18714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748615.418835:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.418847:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.418857:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748615.419278:0:18714:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000948fff72 reply state 00000000e7ed5990 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.419293:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.419300:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:1.0:1788748615.419303:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788748615.419306:0:18714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788748615.419314:0:18714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788748615.419483:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75569442-d759-49f9-ac7f-46ed0f7f5707+9:15596:x1875638368728320:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 779us (3797us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788748615.419491:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1788748615.427062:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.427159:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368728576 00000100:00100000:2.0:1788748615.427223:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368728576 00000100:00100000:2.0:1788748615.427341:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1788748615.427352:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+9:15596:x1875638368728576:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748615.427583:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+10:15596:x1875638368728576:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 233us (530us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788748615.427591:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1788748615.433248:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.433359:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368728832 00000100:00100000:2.0:1788748615.433368:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368728832 00000100:00100000:2.0:1788748615.433419:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1788748615.433434:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+10:15596:x1875638368728832:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748615.433457:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748615.433475:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b6f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4099 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433544:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433557:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433571:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433588:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433596:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433615:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748615.433724:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788748615.433785:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433792:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433799:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433804:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fea00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748615.433809:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433816:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433826:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:2.0:1788748615.433829:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748615.433833:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433839:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b6fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433852:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433867:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433873:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433878:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fec00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748615.433880:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433886:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433893:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8add91e32d00) 00010000:00010000:2.0:1788748615.433895:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748615.433897:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433903:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b704 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433931:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b6f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4099 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433939:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:2.0:1788748615.433941:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748615.433945:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b6f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4099 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.433962:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73fe400, rc 0) 00000100:00100000:2.0:1788748615.434006:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+11:15596:x1875638368728832:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 574us (767us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788748615.434014:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1788748615.438143:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.439793:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368728960 00000100:00100000:1.0:1788748615.439805:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368728960 00000100:00100000:1.0:1788748615.439921:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1788748615.439932:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+11:15596:x1875638368728960:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748615.439955:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748615.439974:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b712 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40a0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.440066:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.440080:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.440092:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748615.440119:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788748615.440122:0:17184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748615.440139:0:17184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.440163:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b712 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.440181:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.440189:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:1.0:1788748615.440192:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788748615.440196:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69400, rc 0) 00000100:00100000:1.0:1788748615.440261:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+12:15596:x1875638368728960:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 330us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.440284:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:0.0:1788748615.453717:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.453991:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368729088 00000100:00100000:1.0:1788748615.454001:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368729088 00000100:00100000:1.0:1788748615.454057:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1788748615.454068:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+12:15596:x1875638368729088:12345-192.168.203.22@tcp:37:lfs.0 00000100:00100000:1.0:1788748615.465074:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+12:15596:x1875638368729088:12345-192.168.203.22@tcp:37:lfs.0 Request processed in 10999us (11357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.465088:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1788748615.469531:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.469687:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368729344 00000100:00100000:2.0:1788748615.469696:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368729344 00000100:00100000:2.0:1788748615.469754:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1788748615.469764:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb6baa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+12:15596:x1875638368729344:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788748615.469986:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb6baa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+13:15596:x1875638368729344:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 223us (463us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788748615.469994:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000040:00080000:0.0:1788748615.525011:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748615.542029:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.542163:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368729472 00000100:00100000:2.0:1788748615.542173:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368729472 00000100:00100000:2.0:1788748615.542231:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1788748615.542241:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+11:15602:x1875638368729472:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788748615.542278:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748615.542298:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40a7 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542396:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542410:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542421:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542447:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542454:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542460:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542536:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff200/0x9ba0f20a02e1b735 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542545:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff200/0x9ba0f20a02e1b735 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542551:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff200/0x9ba0f20a02e1b735 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748615.542585:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788748615.542589:0:17185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788748615.542624:0:17185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff200/0x9ba0f20a02e1b735 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542636:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542642:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542663:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542680:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fec00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748615.542684:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542691:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542703:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:2.0:1788748615.542706:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748615.542712:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542718:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b727 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542734:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542739:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542745:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542751:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fea00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748615.542753:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542759:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542778:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8add91e32d00) 00010000:00010000:2.0:1788748615.542780:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748615.542784:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542790:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b72e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542816:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a7 expref: 13 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542830:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff200/0x9ba0f20a02e1b735 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a7 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.542837:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:2.0:1788748615.542839:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788748615.542842:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73ff200, rc 0) 00000100:00100000:2.0:1788748615.542915:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+12:15602:x1875638368729472:12345-192.168.203.22@tcp:101:bash.0 Request processed in 675us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748615.543415:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1788748615.545247:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.545564:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368729600 00000100:00100000:1.0:1788748615.545573:0:17197:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368729600 00000100:00100000:1.0:1788748615.545664:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1788748615.545674:0:17197:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:214085a6-5521-4af6-bbcd-d13001081488+5:15602:x1875638368729600:12345-192.168.203.22@tcp:900:bash.0 00000100:00100000:1.0:1788748615.545754:0:17197:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:214085a6-5521-4af6-bbcd-d13001081488+5:15602:x1875638368729600:12345-192.168.203.22@tcp:900:bash.0 Request processed in 82us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.545762:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788748615.548775:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748615.548853:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368729856 00000100:00100000:3.0:1788748615.548916:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368729856 00000100:00100000:3.0:1788748615.549011:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:3.0:1788748615.549020:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+12:15602:x1875638368729856:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788748615.549040:0:18714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788748615.549057:0:18714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba800/0x9ba0f20a02e1b73c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40ae expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.549150:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.549166:0:18714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.549175:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.549207:0:18714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.549220:0:18714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 12 pid: 17184 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748615.549234:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388726400:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788748615.549825:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addbf477b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748615.552903:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748615.553007:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368729984 00000100:00100000:0.0:1788748615.553017:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368729984 00010000:00010000:0.0:1788748615.553057:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 13 pid: 17184 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748615.553104:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788748615.553113:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+13:2411:x1875638368729984:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748615.553145:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748615.553152:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 13 pid: 17184 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748615.553165:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 13 pid: 17184 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748615.553185:0:17170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:0.0:1788748615.553190:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748615.553199:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748615.553208:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748615.553228:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748615.553294:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75569442-d759-49f9-ac7f-46ed0f7f5707+13:2411:x1875638368729984:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 181us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748615.553302:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00010000:00010000:3.0:1788748615.554753:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b719 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40a0 expref: 12 pid: 17184 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748615.554776:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388726400:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788748615.554797:0:18714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.554964:0:18714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.554972:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.554997:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555015:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555025:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555700:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555713:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555721:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748615.555731:0:18714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788748615.555753:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555760:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555767:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555773:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addb3bbaa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748615.555777:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555785:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555807:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:2.0:1788748615.555810:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748615.555816:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555822:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bbaa00/0x9ba0f20a02e1b743 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788748615.555833:0:18714:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000043af4052 reply state 00000000a8b33d4c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555843:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555849:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8adc82598400) 00010000:00010000:2.0:1788748615.555851:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748615.555853:0:18714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788748615.555956:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addb3bba800/0x9ba0f20a02e1b73c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 15 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555972:0:18714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 14 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.555979:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748615.555981:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788748615.555984:0:18714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73fec00, rc 0) 00000100:00100000:2.0:1788748615.556076:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+15:15602:x1875638368729856:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7056us (7307us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788748615.556084:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:2.0:1788748615.566990:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.567083:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368730112 00000100:00100000:1.0:1788748615.567093:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368730112 00000100:00100000:1.0:1788748615.567184:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1788748615.567195:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+15:15602:x1875638368730112:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788748615.567219:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748615.567239:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b75f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40b5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.567364:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.568805:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.568820:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748615.568881:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788748615.568886:0:17186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788748615.568912:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.568923:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.568961:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b75f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.568982:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 16 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.568989:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:1.0:1788748615.568991:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748615.568995:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68800, rc 0) 00000100:00100000:1.0:1788748615.569067:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+16:15602:x1875638368730112:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1873us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748615.569076:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1788748615.572192:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.572289:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368730368 00000100:00100000:2.0:1788748615.572299:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368730368 00000100:00100000:2.0:1788748615.572473:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1788748615.572484:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+16:15602:x1875638368730368:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1788748615.572896:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+17:15602:x1875638368730368:12345-192.168.203.22@tcp:35:bash.0 Request processed in 412us (712us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788748615.572904:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00010000:00010000:1.0:1788748615.588851:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748615.653987:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.654160:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368730624 00000100:00100000:1.0:1788748615.654184:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368730624 00000100:00100000:1.0:1788748615.654244:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1788748615.654254:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+17:15612:x1875638368730624:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788748615.654278:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748615.654299:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b76d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40bc expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748615.654426:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788748615.654642:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b76d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40bc expref: 19 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.654667:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8add864c2e00) 00010000:00010000:1.0:1788748615.654670:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788748615.654675:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b76d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40bc expref: 19 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748615.654687:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69200, rc 0) 00000100:00100000:1.0:1788748615.654799:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+18:15612:x1875638368730624:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 545us (821us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788748615.654806:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1788748615.659639:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748615.659975:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368730880 00000100:00100000:1.0:1788748615.659985:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368730880 00000100:00100000:1.0:1788748615.660048:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1788748615.660058:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+18:15612:x1875638368730880:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748615.660279:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+19:15612:x1875638368730880:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 222us (647us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788748615.660286:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788748615.709985:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.710719:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368731136 00000100:00100000:2.0:1788748615.710732:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368731136 00000100:00100000:2.0:1788748615.710799:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1788748615.710809:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+19:15615:x1875638368731136:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788748615.710833:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748615.710861:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b77b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40c3 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.710963:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff000/0x9ba0f20a02e1b782 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.710977:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff000/0x9ba0f20a02e1b782 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.710989:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff000/0x9ba0f20a02e1b782 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748615.711004:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788748615.711099:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b77b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40c3 expref: 22 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.711135:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff000/0x9ba0f20a02e1b782 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40c3 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.711144:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748615.711147:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748615.711150:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73ff000, rc 0) 00000100:00100000:2.0:1788748615.711213:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+21:15615:x1875638368731136:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 405us (1246us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788748615.711220:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1788748615.715784:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748615.715878:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368731392 00000100:00100000:2.0:1788748615.715893:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368731392 00000100:00100000:2.0:1788748615.716007:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1788748615.716017:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+21:15615:x1875638368731392:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1788748615.716088:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716105:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716117:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716158:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716166:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716190:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716196:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ffe00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748615.716201:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716209:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716221:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748615.716234:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788748615.716239:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748615.716246:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b790 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748615.716368:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+21:15615:x1875638368731392:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 349us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748615.716377:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1788748615.720152:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748615.720201:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748615.721089:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368731264 00000100:00100000:3.0:1788748615.721104:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368731264 00000100:00100000:3.0:1788748615.722491:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1788748615.722531:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:214085a6-5521-4af6-bbcd-d13001081488+21:2411:x1875638368731264:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748615.722708:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748615.722745:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff000/0x9ba0f20a02e1b782 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40c3 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748615.722771:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:3.0:1788748615.722777:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748615.723192:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:214085a6-5521-4af6-bbcd-d13001081488+20:2411:x1875638368731264:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 684us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748615.723203:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788748615.724537:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368731648 00000100:00100000:1.0:1788748615.724558:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368731648 00000100:00100000:1.0:1788748615.724630:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1788748615.724642:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+20:15615:x1875638368731648:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788748615.725103:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+21:15615:x1875638368731648:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 461us (4897us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788748615.725186:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000040:00080000:2.0:1788748615.973133:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788748616.093193:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748616.093381:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368731904 00000100:00100000:2.0:1788748616.093394:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368731904 00000100:00100000:2.0:1788748616.093473:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1788748616.093484:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+21:15646:x1875638368731904:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1788748616.093527:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748616.093565:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b797 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40ca expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.093755:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b79e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.093773:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b79e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.093791:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b79e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788748616.093805:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788748616.094257:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b797 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ca expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.094283:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b79e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ca expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.094293:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748616.094297:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788748616.094300:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73fe800, rc 0) 00000100:00100000:2.0:1788748616.094453:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+23:15646:x1875638368731904:12345-192.168.203.22@tcp:101:cat.0 Request processed in 971us (1274us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788748616.094462:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1788748616.100221:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748616.100287:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748616.100789:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368732288 00000100:00100000:1.0:1788748616.100803:0:17172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368732288 00000100:00100000:1.0:1788748616.100901:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1788748616.100914:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+23:2410:x1875638368732288:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788748616.100934:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748616.100969:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b79e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ca expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.100998:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:1.0:1788748616.101005:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788748616.101077:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+22:2410:x1875638368732288:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 166us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748616.101086:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1788748616.102221:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368732160 00000100:00100000:3.0:1788748616.102234:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368732160 00000100:00100000:3.0:1788748616.102302:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788748616.102313:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+22:15646:x1875638368732160:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:3.0:1788748616.103245:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+23:15646:x1875638368732160:12345-192.168.203.22@tcp:35:cat.0 Request processed in 924us (2947us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788748616.103256:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1788748616.175737:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748616.175971:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368732544 00000100:00100000:1.0:1788748616.175981:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368732544 00000100:00100000:1.0:1788748616.176047:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:1.0:1788748616.176058:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+23:15652:x1875638368732544:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:1.0:1788748616.176081:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748616.176101:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7ac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40d1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.176238:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.176253:0:17184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 24 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.176262:0:17184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.176270:0:17184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.176302:0:17184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.176368:0:17184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 24 pid: 17186 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748616.176380:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17184:1875638388726528:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748616.176471:0:17184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 24 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.176480:0:17184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 24 pid: 18714 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748616.176488:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17184:1875638388726656:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788748616.176527:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb50660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748616.190892:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748616.190935:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748616.191188:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368732672 00000100:00100000:3.0:1788748616.191198:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368732672 00010000:00010000:3.0:1788748616.191241:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 25 pid: 17186 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748616.191294:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368732800 00000100:00100000:3.0:1788748616.191298:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368732800 00010000:00010000:3.0:1788748616.191360:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 26 pid: 18714 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748616.191377:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788748616.191396:0:17171:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788748616.191406:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+26:2411:x1875638368732672:12345-192.168.203.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788748616.191408:0:17171:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788748616.191439:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748616.191466:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 26 pid: 17186 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.191487:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 26 pid: 17186 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.191530:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00000100:00100000:3.0:1788748616.191536:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00010000:00010000:0.0:1788748616.191541:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748616.191554:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:214085a6-5521-4af6-bbcd-d13001081488+26:2411:x1875638368732800:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748616.191557:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.191567:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788748616.191570:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748616.191581:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 26 pid: 18714 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748616.191596:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 26 pid: 18714 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748616.191625:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:3.0:1788748616.191632:0:17171:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748616.191653:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748616.191659:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+26:2411:x1875638368732672:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 254us (761us total) trans 0 rc 0/0 00010000:00010000:3.0:1788748616.191678:0:17171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748616.191685:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00010000:00010000:3.0:1788748616.191711:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748616.191759:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:214085a6-5521-4af6-bbcd-d13001081488+25:2411:x1875638368732800:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 210us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.191778:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00010000:00010000:1.0:1788748616.192123:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b766 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40b5 expref: 24 pid: 17186 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748616.192141:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17184:1875638388726528:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748616.192153:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b751 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ae expref: 23 pid: 18714 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748616.192165:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17184:1875638388726656:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788748616.192185:0:17184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.192194:0:17184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.192201:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788748616.192219:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788748616.192446:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7ac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d1 expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.192464:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69200/0x9ba0f20a02e1b7b3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d1 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.192473:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:1.0:1788748616.192477:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788748616.192480:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a69200, rc 0) 00000100:00100000:1.0:1788748616.192526:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+23:15652:x1875638368732544:12345-192.168.203.22@tcp:101:dd.0 Request processed in 16468us (16796us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788748616.192535:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1788748616.196723:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748616.196838:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368732928 00000100:00100000:0.0:1788748616.196858:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368732928 00000100:00100000:0.0:1788748616.196914:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1788748616.196923:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+23:15652:x1875638368732928:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1788748616.196945:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748616.196965:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40d8 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.197000:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.197015:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.197041:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.197166:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 25 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.197184:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.197192:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:0.0:1788748616.197196:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788748616.197199:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940800, rc 0) 00000100:00100000:0.0:1788748616.197262:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+24:15652:x1875638368732928:12345-192.168.203.22@tcp:101:dd.0 Request processed in 339us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748616.197270:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1788748616.204185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748616.204581:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368733184 00000100:00100000:2.0:1788748616.204590:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368733184 00000100:00100000:2.0:1788748616.204659:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1788748616.204670:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+24:15652:x1875638368733184:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:2.0:1788748616.205032:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.205050:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.205061:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748616.205103:0:18714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788748616.205126:0:18714:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000031bbd3a7 reply state 0000000025985cbb transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.205139:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748616.205145:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748616.205148:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788748616.205151:0:18714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748616.205299:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+27:15652:x1875638368733184:12345-192.168.203.22@tcp:36:dd.0 Request processed in 629us (1122us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788748616.205307:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000020:00080000:2.0:1788748616.205311:0:18714:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788748616.212676:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748616.214383:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368733312 00000100:00100000:0.0:1788748616.214396:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368733312 00000100:00100000:0.0:1788748616.214453:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:0.0:1788748616.214464:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+27:15652:x1875638368733312:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1788748616.214488:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748616.214508:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40df expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.214562:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40df expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.214598:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40df expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.214637:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:0.0:1788748616.214662:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748616.214667:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940200, rc 0) 00000100:00100000:0.0:1788748616.214790:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+28:15652:x1875638368733312:12345-192.168.203.22@tcp:101:dd.0 Request processed in 316us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748616.214798:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1788748616.247554:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748616.247767:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368733568 00000100:00100000:0.0:1788748616.247777:0:17172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368733568 00000100:00100000:0.0:1788748616.247840:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1788748616.247850:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+28:15652:x1875638368733568:12345-192.168.203.22@tcp:103:dd.0 00010000:00010000:0.0:1788748616.247866:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748616.247891:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40df expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.247910:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:0.0:1788748616.247915:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748616.249527:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+27:15652:x1875638368733568:12345-192.168.203.22@tcp:103:dd.0 Request processed in 1669us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748616.249539:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788748616.256522:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748616.256621:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368733696 00000100:00100000:1.0:1788748616.256631:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368733696 00000100:00100000:1.0:1788748616.256702:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1788748616.256713:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+27:15652:x1875638368733696:12345-192.168.203.22@tcp:58:dd.0 00010000:00010000:1.0:1788748616.256810:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.256828:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748616.256840:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788748616.261505:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788748616.261763:0:17184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788748616.261886:0:17184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788748616.261987:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+27:15652:x1875638368733696:12345-192.168.203.22@tcp:58:dd.0 Request processed in 5271us (5469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748616.261998:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1788748616.270489:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748616.270961:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368733824 00000100:00100000:0.0:1788748616.270971:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368733824 00000100:00100000:0.0:1788748616.271352:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1788748616.271363:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+27:15652:x1875638368733824:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1788748616.271390:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748616.271411:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40e6 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.271464:0:17185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.271475:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.271492:0:17185:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.271505:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.271517:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:0.0:1788748616.271520:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788748616.271524:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 28 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748616.271531:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8addbc940200, rc 0) 00000100:00100000:0.0:1788748616.271601:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+28:15652:x1875638368733824:12345-192.168.203.22@tcp:101:dd.0 Request processed in 240us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748616.271609:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1788748616.505855:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748616.505904:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748616.505946:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748616.505969:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734336 00000100:00100000:3.0:1788748616.505980:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734336 00000100:00100000:2.0:1788748616.505980:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748616.506019:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00080000:2.0:1788748616.506036:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748616.506057:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734848 00000100:00100000:3.0:1788748616.506062:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734848 00000100:00100000:2.0:1788748616.506063:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748616.506099:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788748616.506123:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368734336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.506190:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368734336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 69us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.506199:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1788748616.506204:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368733952 00000100:00100000:0.0:1788748616.506210:0:17179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368733952 00000100:00100000:3.0:1788748616.506231:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1788748616.506241:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2413:x1875638368734848:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788748616.506251:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:0.0:1788748616.506275:0:17179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:2413:x1875638368733952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.506283:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2413:x1875638368734848:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.506291:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1788748616.506312:0:17179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c63e85-f7a2-441c-9884-b3ba050117ac+13:2413:x1875638368733952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748616.506354:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00080000:3.0:1788748616.506366:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748616.506457:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748616.506477:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734464 00000100:00100000:3.0:1788748616.506481:0:18693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734464 00000100:00100000:3.0:1788748616.506508:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1788748616.506514:0:18693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368734464:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.507622:0:18693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368734464:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1102us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.507632:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00080000:3.0:1788748616.507680:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748616.507738:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748616.510565:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734080 00000100:00100000:1.0:1788748616.510580:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734080 00000100:00100000:3.0:1788748616.510716:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748616.510738:0:19687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734976 00000100:00100000:3.0:1788748616.510742:0:19687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734976 00000100:00100000:3.0:1788748616.510782:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1788748616.510792:0:19687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2413:x1875638368734976:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.510856:0:19687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2413:x1875638368734976:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.510864:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00080000:3.0:1788748616.510911:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748616.510961:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734592 00000100:00100000:3.0:1788748616.510966:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734592 00000100:00100000:3.0:1788748616.510985:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734208 00000100:00100000:3.0:1788748616.510987:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734208 00000100:00100000:3.0:1788748616.511010:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368734720 00000100:00100000:3.0:1788748616.511013:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368734720 00000100:00100000:3.0:1788748616.511029:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:3.0:1788748616.511036:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+28:2413:x1875638368734080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.511070:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+28:2413:x1875638368734080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (5225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.511077:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:3.0:1788748616.511111:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788748616.511118:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+12:2413:x1875638368734592:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.511167:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+12:2413:x1875638368734592:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 49us (5221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.511173:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788748616.511201:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1788748616.511208:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368734208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.511234:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368734208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (5172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.511241:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1788748616.511253:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1788748616.511259:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2413:x1875638368734720:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788748616.511282:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75569442-d759-49f9-ac7f-46ed0f7f5707+5:2413:x1875638368734720:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748616.511288:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00010000:00010000:3.0:1788748616.613044:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788748616.996560:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788748616.996568:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788748616.996593:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788748616.996604:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788748616.996754:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc840bc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17221:1875638388726784:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788748616.996852:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86000 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.004280:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc840bc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17221:1875638388726784:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788748617.005824:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.007257:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368735104 00000100:00100000:0.0:1788748617.007269:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368735104 00000100:00100000:0.0:1788748617.007424:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:0.0:1788748617.007446:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+28:15653:x1875638368735104:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788748617.007477:0:17185:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788748617.007609:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb533c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+28:15653:x1875638368735104:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 175us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.007617:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00080000:3.0:1788748617.008534:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788748617.017914:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.019419:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368735232 00000100:00100000:0.0:1788748617.019444:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368735232 00000100:00100000:0.0:1788748617.019513:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1788748617.019524:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+28:15653:x1875638368735232:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788748617.019596:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019612:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019627:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019690:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019715:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019723:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019747:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019756:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019763:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748617.019808:0:17184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788748617.019813:0:17184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748617.019827:0:17184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019838:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019844:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019851:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019857:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8addbc940e00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748617.019861:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019873:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019885:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8add91e32200) 00010000:00010000:0.0:1788748617.019887:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748617.019893:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019899:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940e00/0x9ba0f20a02e1b7eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019912:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019917:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019923:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019927:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748617.019930:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019935:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019941:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8adc8259a900) 00010000:00010000:0.0:1788748617.019943:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748617.019946:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019960:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b7f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019976:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019982:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019988:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.019993:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748617.019996:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.020002:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.020008:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:0.0:1788748617.020010:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748617.020013:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.020018:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b7f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.020521:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc842fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+28:15653:x1875638368735232:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 996us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.020530:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1788748617.028850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.029070:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368735488 00000100:00100000:0.0:1788748617.029079:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368735488 00000100:00100000:0.0:1788748617.029191:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1788748617.029203:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+28:15653:x1875638368735488:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748617.029225:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748617.029244:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b800 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40ed expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029381:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029398:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029410:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748617.029422:0:17185:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788748617.029511:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029519:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029526:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029532:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748617.029536:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029543:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029568:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:0.0:1788748617.029571:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788748617.029576:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029582:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b807 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029626:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b800 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ed expref: 30 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029646:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8add91e32200) 00010000:00010000:0.0:1788748617.029649:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788748617.029653:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b800 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40ed expref: 30 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.029664:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748617.029726:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+29:15653:x1875638368735488:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 525us (889us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788748617.029733:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:1.0:1788748617.040746:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748617.041086:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368735616 00000100:00100000:2.0:1788748617.041095:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368735616 00000100:00100000:2.0:1788748617.041190:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1788748617.041201:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+29:15653:x1875638368735616:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788748617.041238:0:17186:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788748617.041380:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+29:15653:x1875638368735616:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 180us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.041387:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1788748617.051825:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.056933:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368735872 00000100:00100000:1.0:1788748617.056948:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368735872 00000100:00100000:1.0:1788748617.057027:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:1.0:1788748617.057038:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+29:15653:x1875638368735872:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748617.057081:0:18714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748617.057103:0:18714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b815 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40f4 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788748617.057532:0:18714:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1788748617.057539:0:18714:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788748617.057557:0:18714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788748617.057710:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b81c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.057725:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b81c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.057736:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b81c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.057789:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b815 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40f4 expref: 32 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.057807:0:18714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b81c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40f4 expref: 31 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.057816:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32400) 00010000:00010000:1.0:1788748617.057819:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788748617.057822:0:18714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adc83a68800, rc 0) 00000100:00100000:1.0:1788748617.057894:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+31:15653:x1875638368735872:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 857us (6077us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788748617.057902:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1788748617.072531:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.072695:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368736128 00000100:00100000:0.0:1788748617.072705:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368736128 00000100:00100000:0.0:1788748617.072765:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:0.0:1788748617.072775:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+31:15653:x1875638368736128:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788748617.072846:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748617.072872:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68800/0x9ba0f20a02e1b81c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40f4 expref: 31 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.072901:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32400) 00010000:00010000:0.0:1788748617.072911:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788748617.073117:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073130:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073140:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073154:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073161:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073167:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073213:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073220:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073225:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073230:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148ba00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748617.073233:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073246:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073255:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:0.0:1788748617.073257:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748617.073261:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073265:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b82a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073276:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073281:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073286:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073290:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:0.0:1788748617.073293:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073298:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073303:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb51f12c (ffff8adc8259a900) 00010000:00010000:0.0:1788748617.073306:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788748617.073308:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.073518:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b831 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb51f12c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.073603:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+30:15653:x1875638368736128:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 828us (1079us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788748617.073610:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:3.0:1788748617.077144:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.081455:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368736256 00000100:00100000:1.0:1788748617.081487:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368736256 00000100:00100000:1.0:1788748617.081559:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1788748617.081569:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+30:15653:x1875638368736256:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748617.081588:0:18714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748617.081608:0:18714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b838 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa40fb expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.081652:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fac00/0x9ba0f20a02e1b83f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.081665:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fac00/0x9ba0f20a02e1b83f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.081676:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fac00/0x9ba0f20a02e1b83f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.081770:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69400/0x9ba0f20a02e1b838 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40fb expref: 32 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.081788:0:18714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fac00/0x9ba0f20a02e1b83f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40fb expref: 31 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.081797:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:1.0:1788748617.081800:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788748617.081803:0:18714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813fac00, rc 0) 00000100:00100000:1.0:1788748617.081864:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+31:15653:x1875638368736256:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 297us (4729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.081871:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788748617.094668:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748617.095059:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368736512 00000100:00100000:2.0:1788748617.095069:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368736512 00000100:00100000:2.0:1788748617.095141:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788748617.095152:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+31:15653:x1875638368736512:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788748617.095246:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.095264:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.095276:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788748617.095481:0:17186:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788748617.095491:0:17186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 534082173297ns, next at 535082171142ns, rc = 0 00000004:00010000:2.0:1788748617.095539:0:17186:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f56c1729 reply state 000000009024780b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.095553:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.095560:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:2.0:1788748617.095563:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788748617.095566:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788748617.095667:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+33:15653:x1875638368736512:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 516us (1006us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788748617.095674:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1788748617.100285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.101104:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368736640 00000100:00100000:1.0:1788748617.101129:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368736640 00000100:00100000:1.0:1788748617.101193:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:1.0:1788748617.101204:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+33:15653:x1875638368736640:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788748617.101227:0:18714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788748617.101247:0:18714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4102 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.101305:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 34 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.101352:0:18714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 34 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.101373:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:1.0:1788748617.101378:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788748617.101383:0:18714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add813faa00, rc 0) 00000100:00100000:0.0:1788748617.101574:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+34:15653:x1875638368736640:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 371us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.101582:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1788748617.108262:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.111005:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368736768 00000100:00100000:0.0:1788748617.111021:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368736768 00000100:00100000:0.0:1788748617.111228:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1788748617.111240:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:214085a6-5521-4af6-bbcd-d13001081488+5:2411:x1875638368736768:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788748617.111522:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:214085a6-5521-4af6-bbcd-d13001081488+6:2411:x1875638368736768:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 284us (3268us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788748617.111531:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788748617.115556:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.115627:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368737024 00000100:00100000:1.0:1788748617.115648:0:17187:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368737024 00000100:00100000:1.0:1788748617.115808:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1788748617.115823:0:17187:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+34:15653:x1875638368737024:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788748617.116031:0:17187:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:214085a6-5521-4af6-bbcd-d13001081488+35:15653:x1875638368737024:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 213us (484us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788748617.116039:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788748617.118987:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.119687:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368737280 00000100:00100000:1.0:1788748617.119747:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368737280 00000100:00100000:1.0:1788748617.119807:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788748617.119817:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+35:15653:x1875638368737280:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788748617.119936:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+35:15653:x1875638368737280:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 120us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.119943:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:2.0:1788748617.123227:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.123868:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368737408 00000100:00100000:0.0:1788748617.123879:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368737408 00000100:00100000:0.0:1788748617.123943:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1788748617.123953:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+35:15653:x1875638368737408:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748617.123973:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748617.123994:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b854 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4109 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.124058:0:17185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b85b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.124085:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b85b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.124098:0:17185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b85b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788748617.124142:0:17185:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788748617.124161:0:17185:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b85b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.124186:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148bc00/0x9ba0f20a02e1b854 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4109 expref: 37 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.124206:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b85b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4109 expref: 36 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.124215:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:0.0:1788748617.124219:0:17185:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788748617.124222:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148ba00, rc 0) 00000100:00100000:0.0:1788748617.124285:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+36:15653:x1875638368737408:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 333us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.124292:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1788748617.130512:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.130792:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368737536 00000100:00100000:0.0:1788748617.130802:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368737536 00000100:00100000:0.0:1788748617.130902:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1788748617.130912:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:214085a6-5521-4af6-bbcd-d13001081488+6:2410:x1875638368737536:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748617.130929:0:18692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748617.130962:0:18692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4110 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788748617.130989:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e2349, blocks: 0x0 00010000:00010000:0.0:1788748617.131010:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=534s v=(0 0) 00010000:00010000:0.0:1788748617.131015:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748617.131023:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 7 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.131043:0:18692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 7 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.131056:0:18692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148bc00, rc 0) 00000100:00100000:0.0:1788748617.131114:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:214085a6-5521-4af6-bbcd-d13001081488+7:2410:x1875638368737536:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 203us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.131122:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788748617.134419:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.134655:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368737792 00000100:00100000:1.0:1788748617.134665:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368737792 00000100:00100000:1.0:1788748617.134711:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1788748617.134720:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+36:15653:x1875638368737792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788748617.134843:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+36:15653:x1875638368737792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 124us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.134945:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1788748617.139264:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.139707:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368737920 00000100:00100000:0.0:1788748617.139716:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368737920 00000100:00100000:1.0:1788748617.139836:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1788748617.139878:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+36:15653:x1875638368737920:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788748617.142246:0:17165:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788748617.142261:0:17165:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788748617.142439:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142452:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142470:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142476:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69000 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.142481:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142489:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142505:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8add91e32d00) 00010000:00010000:2.0:1788748617.142508:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748617.142513:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142519:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69000/0x9ba0f20a02e1b69b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142548:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142554:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142560:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142565:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68a00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.142568:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142585:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142594:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:2.0:1788748617.142597:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748617.142600:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142606:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68a00/0x9ba0f20a02e1b6a2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142620:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142626:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142631:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142647:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fea00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.142650:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142657:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142664:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8adc82598400) 00010000:00010000:2.0:1788748617.142666:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748617.142669:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142681:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fea00/0x9ba0f20a02e1b74a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142702:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142707:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142713:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142718:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ffe00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.142721:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142726:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142734:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748617.142736:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748617.142740:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142745:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffe00/0x9ba0f20a02e1b7cf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142756:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142762:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142773:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142778:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fe600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.142781:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142787:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142794:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:2.0:1788748617.142796:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788748617.142799:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.142803:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe600/0x9ba0f20a02e1b846 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748617.143738:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388726912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788748617.143813:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748617.143940:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388726912 00000100:00100000:0.0:1788748617.143949:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388726912 00000100:00100000:0.0:1788748617.144012:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748617.144021:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc840bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388726912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788748617.144138:0:19357:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788748617.144142:0:19357:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788748617.144144:0:19357:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788748617.144146:0:19357:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788748617 -> 1788748617 00002000:00010000:0.0:1788748617.144148:0:19357:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:3.0:1788748617.144233:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788748617.144807:0:17165:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1788748617.144877:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.144887:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.144894:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.144900:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a68600 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:1.0:1788748617.144905:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.144922:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.144935:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8add91e32900) 00010000:00010000:1.0:1788748617.144938:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788748617.144942:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.144948:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a68600/0x9ba0f20a02e1b6ef lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748617.145050:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:214085a6-5521-4af6-bbcd-d13001081488+15:15653:x1875638368737920:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 5203us (5794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748617.145059:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788748617.146712:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc840bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1875638388726912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2686us (2892us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788748617.146725:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1788748617.146802:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8adc84950700/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788748617.146809:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388726912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788748617.148307:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.148663:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368738048 00000100:00100000:0.0:1788748617.148671:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368738048 00000100:00100000:0.0:1788748617.148723:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1788748617.148732:0:18690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:214085a6-5521-4af6-bbcd-d13001081488+7:2411:x1875638368738048:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788748617.148834:0:18690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:214085a6-5521-4af6-bbcd-d13001081488+7:2411:x1875638368738048:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 103us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.148841:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1788748617.152087:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.152837:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368738304 00000100:00100000:1.0:1788748617.152860:0:17186:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368738304 00000100:00100000:1.0:1788748617.152923:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1788748617.152934:0:17186:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+15:15653:x1875638368738304:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788748617.152987:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788748617.153015:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148ba00/0x9ba0f20a02e1b85b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4109 expref: 15 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.153036:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:1.0:1788748617.153042:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788748617.153069:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fa000/0x9ba0f20a02e1b869 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.153083:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fa000/0x9ba0f20a02e1b869 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.153103:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fa000/0x9ba0f20a02e1b869 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788748617.153219:0:17186:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000693d8e2a reply state 00000000e635527c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fa000/0x9ba0f20a02e1b869 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.153232:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add813fa000/0x9ba0f20a02e1b869 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.153238:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:1.0:1788748617.153241:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788748617.153243:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788748617.153797:0:17186:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:214085a6-5521-4af6-bbcd-d13001081488+16:15653:x1875638368738304:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 862us (1714us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788748617.153804:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:2.0:1788748617.162518:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.162669:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368738432 00000100:00100000:0.0:1788748617.162680:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368738432 00000100:00100000:0.0:1788748617.162736:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1788748617.162745:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbb0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:214085a6-5521-4af6-bbcd-d13001081488+7:15653:x1875638368738432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788748617.162762:0:18692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788748617.162782:0:18692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa4117 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.162814:0:18692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 8 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.162824:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748617.162829:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748617.162833:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 8 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.162888:0:18692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 8 pid: 18692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.162902:0:18692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 8 pid: 18692 timeout: 634 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.162915:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18692:1875638388727040:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748617.163000:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add88428780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.166412:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18692:1875638388727040:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748617.166446:0:18692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 8 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.166467:0:18692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8add8148aa00, rc 0) 00000100:00100000:0.0:1788748617.166532:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbb0b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:214085a6-5521-4af6-bbcd-d13001081488+8:15653:x1875638368738432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 3781us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.166541:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788748617.169032:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.169987:0:20325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368738560 00000100:00100000:0.0:1788748617.169998:0:20325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368738560 00010000:00010000:0.0:1788748617.170042:0:20325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 8 pid: 18692 timeout: 634 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.170179:0:20325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788748617.170189:0:20325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:214085a6-5521-4af6-bbcd-d13001081488+8:2410:x1875638368738560:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748617.170215:0:20325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748617.170234:0:20325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 8 pid: 18692 timeout: 634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.170247:0:20325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 8 pid: 18692 timeout: 634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.170271:0:20325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b862 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4110 expref: 8 pid: 18692 timeout: 634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.170288:0:20325:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748617.170293:0:20325:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748617.170299:0:20325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 7 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.170309:0:20325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 7 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.170391:0:20325:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 7 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.170404:0:20325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20325:1875638388727168:192.168.203.22@tcp:105: 00000100:00100000:0.0:1788748617.170495:0:20325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add88428780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.172961:0:20325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20325:1875638388727168:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788748617.172983:0:20325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748617.173083:0:20325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:214085a6-5521-4af6-bbcd-d13001081488+7:2410:x1875638368738560:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 2895us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.173093:0:20325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1788748617.175140:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788748617.178159:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368738688 00000100:00100000:1.0:1788748617.178175:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368738688 00000100:00100000:1.0:1788748617.178368:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:1.0:1788748617.178379:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8add85b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:214085a6-5521-4af6-bbcd-d13001081488+7:2410:x1875638368738688:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788748617.178523:0:19357:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788748617.178696:0:19357:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788748617 00002000:00010000:1.0:1788748617.178699:0:19357:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788748616 00002000:00010000:1.0:1788748617.178701:0:19357:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788748617 -> 1788748617 00002000:00010000:1.0:1788748617.178703:0:19357:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788748617.178771:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8add85b4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:214085a6-5521-4af6-bbcd-d13001081488+8:2410:x1875638368738688:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 393us (3638us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788748617.178778:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788748617.182682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748617.184766:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368738816 00000100:00100000:2.0:1788748617.184778:0:18690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368738816 00000100:00100000:0.0:1788748617.184838:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1788748617.184857:0:19687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:214085a6-5521-4af6-bbcd-d13001081488+8:2411:x1875638368738816:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788748617.184900:0:19687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.184919:0:19687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 8 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.184928:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748617.184932:0:19687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748617.184937:0:19687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.184967:0:19687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 8 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.184979:0:19687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 8 pid: 18692 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.184992:0:19687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19687:1875638388727296:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748617.185077:0:19687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8add88428780 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.187920:0:19687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19687:1875638388727296:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748617.187965:0:19687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.190127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.190683:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368738944 00000100:00100000:0.0:1788748617.190693:0:17171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368738944 00010000:00010000:0.0:1788748617.190732:0:17171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 9 pid: 18692 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.190773:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1788748617.190782:0:17171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:214085a6-5521-4af6-bbcd-d13001081488+9:2410:x1875638368738944:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788748617.190796:0:17171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788748617.190816:0:17171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 9 pid: 18692 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.190829:0:17171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 9 pid: 18692 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.190852:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bcebaa1/0x9ba0f20a02e1b870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4117 expref: 9 pid: 18692 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.191512:0:17171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748617.191516:0:17171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788748617.191522:0:17171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.191829:0:17171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.191956:0:17171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788748617.192075:0:17171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84950380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:214085a6-5521-4af6-bbcd-d13001081488+8:2410:x1875638368738944:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1290us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748617.192084:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00010000:00010000:3.0:1788748617.192150:0:19687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192160:0:19687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192185:0:19687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192193:0:19687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192201:0:19687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192208:0:19687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148bc00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:3.0:1788748617.192212:0:19687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192220:0:19687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192234:0:19687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.192261:0:19687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e96957/0x9ba0f20a02e1b877 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.192313:0:19687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:214085a6-5521-4af6-bbcd-d13001081488+7:2411:x1875638368738816:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 7466us (9641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.192376:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1788748617.198130:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748617.198218:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368739200 00000100:00100000:2.0:1788748617.198228:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368739200 00000100:00100000:2.0:1788748617.198287:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1788748617.198297:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+16:15653:x1875638368739200:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788748617.198430:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.198446:0:18714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 16 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.198455:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.198484:0:18714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 16 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.198497:0:18714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 16 pid: 17185 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748617.198509:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbb0b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388727424:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788748617.198596:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.202935:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748617.203021:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368739328 00000100:00100000:3.0:1788748617.203030:0:17170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368739328 00010000:00010000:3.0:1788748617.203079:0:17170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 17 pid: 17185 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.203124:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788748617.203134:0:17170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbb0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:214085a6-5521-4af6-bbcd-d13001081488+17:2410:x1875638368739328:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748617.203148:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748617.203154:0:17170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 17 pid: 17185 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.203168:0:17170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 17 pid: 17185 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.203190:0:17170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:3.0:1788748617.203196:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 17 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.203225:0:17170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.203233:0:17170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.203241:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.203273:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748617.203521:0:17170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbb0b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:214085a6-5521-4af6-bbcd-d13001081488+17:2410:x1875638368739328:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 229us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.203539:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00010000:00010000:0.0:1788748617.203983:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940800/0x9ba0f20a02e1b7c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40d8 expref: 16 pid: 17185 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.204000:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbb0b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388727424:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748617.204019:0:18714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.204027:0:18714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.204034:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.204233:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.204247:0:18714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 16 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.204266:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.204294:0:18714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 16 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.204779:0:18714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 16 pid: 18714 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.204795:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388727552:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788748617.204865:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3b9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.210726:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.210829:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388727552:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788748617.210855:0:18714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.211110:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368739456 00000100:00100000:3.0:1788748617.211117:0:17172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368739456 00010000:00010000:3.0:1788748617.211150:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 17 pid: 18714 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788748617.211186:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1788748617.211195:0:17172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbb0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+17:2410:x1875638368739456:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788748617.211208:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788748617.211215:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 17 pid: 18714 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.211226:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 17 pid: 18714 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.211264:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add813faa00/0x9ba0f20a02e1b84d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa4102 expref: 17 pid: 18714 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.211278:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:3.0:1788748617.211283:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.211293:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.211301:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788748617.211469:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788748617.211566:0:17172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbb0b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:214085a6-5521-4af6-bbcd-d13001081488+16:2410:x1875638368739456:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 371us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.211574:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00010000:00010000:2.0:1788748617.211699:0:18714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.211707:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748617.211812:0:18714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788748617.211920:0:18714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788748617.211955:0:18714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788748617.212032:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbb0bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18714:1875638388727680:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788748617.212087:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748617.212123:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a86c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788748617.212800:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388727680 00000100:00100000:3.0:1788748617.212806:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388727680 00000100:00100000:3.0:1788748617.212851:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788748617.212868:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbb0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18714:x1875638388727680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788748617.212957:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbb0b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18714:x1875638388727680:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.212963:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788748617.213046:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbb0bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18714:1875638388727680:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788748617.213195:0:18714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788748617.213242:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18714:1875638388727808:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788748617.213283:0:18714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748617.213305:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb50660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788748617.213388:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388727808 00000100:00100000:2.0:1788748617.213392:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388727808 00000100:00100000:2.0:1788748617.213421:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788748617.213427:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18714:x1875638388727808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788748617.213518:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18714:x1875638388727808:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (234us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788748617.213535:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788748617.213563:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18714:1875638388727808:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788748617.213591:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213600:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213608:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213614:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148aa00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.213617:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213625:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213647:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:2.0:1788748617.213650:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748617.213654:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213675:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8add8148aa00/0x9ba0f20a02e1b885 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213701:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213707:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213713:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213718:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adc83a69e00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.213721:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213726:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213735:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748617.213737:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788748617.213743:0:18714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 19 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213753:0:18714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 19 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213762:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 19 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.213821:0:18714:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8addbc940200/0x9ba0f20a02e1b7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa40e6 expref: 19 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748617.213833:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbb0ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388727936:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788748617.213878:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8addb3a860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788748617.219744:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748617.219810:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368739584 00000100:00100000:3.0:1788748617.219820:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368739584 00000100:00100000:3.0:1788748617.219889:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788748617.219900:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addb6ba9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+20:15652:x1875638368739584:12345-192.168.203.22@tcp:49:dd.0 00000100:00100000:3.0:1788748617.220034:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addb6ba9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+20:15652:x1875638368739584:12345-192.168.203.22@tcp:49:dd.0 Request processed in 135us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748617.220041:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1788748617.221174:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbb0ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18714:1875638388727936:192.168.203.22@tcp:105: 00010000:00010000:2.0:1788748617.221200:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221211:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adc83a69e00/0x9ba0f20a02e1b7dd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221242:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221266:0:18714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221278:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221288:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221294:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221301:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221351:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73ffc00 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.221355:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221594:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221607:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748617.221610:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788748617.221614:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221619:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ffc00/0x9ba0f20a02e1b88c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221629:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221645:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221651:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221656:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fe400 already unused, calling callback (ffffffffc191c4f0) 00010000:00010000:2.0:1788748617.221659:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221664:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221683:0:18714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748617.221685:0:18714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748617.221689:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.221696:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe400/0x9ba0f20a02e1b87e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788748617.221903:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:214085a6-5521-4af6-bbcd-d13001081488+19:15653:x1875638368739200:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 23606us (23780us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788748617.221912:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000020:00080000:2.0:1788748617.221917:0:18714:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788748617.225692:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748617.226985:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368739712 00000100:00100000:2.0:1788748617.226998:0:17184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368739712 00000100:00100000:2.0:1788748617.227067:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:2.0:1788748617.227076:0:17184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+19:15652:x1875638368739712:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:2.0:1788748617.227097:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788748617.227118:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff000/0x9ba0f20a02e1b893 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc98bf917a4aa411e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.227153:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b89a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.227167:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b89a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.227179:0:17184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b89a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.227304:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73ff000/0x9ba0f20a02e1b893 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa411e expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.227343:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fe800/0x9ba0f20a02e1b89a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc98bf917a4aa411e expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.227352:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8adc82598d00) 00010000:00010000:2.0:1788748617.227355:0:17184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788748617.227370:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8adda73fe800, rc 0) 00000100:00100000:2.0:1788748617.227426:0:17184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:214085a6-5521-4af6-bbcd-d13001081488+20:15652:x1875638368739712:12345-192.168.203.22@tcp:101:dd.0 Request processed in 350us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748617.227433:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1788748617.230356:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788748617.231742:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368739968 00000100:00100000:2.0:1788748617.231754:0:17188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368739968 00000100:00100000:2.0:1788748617.231821:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788748617.231832:0:17188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+20:15653:x1875638368739968:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788748617.232094:0:17188:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788748617.232125:0:17188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788748617.232158:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.232174:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.232186:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.232211:0:17188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.232218:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.232224:0:17188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788748617.232251:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788748617.232630:0:17173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788748617.232648:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.232656:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8adda73fec00 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748617.232660:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.232668:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.232680:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8add91e32a00) 00010000:00010000:1.0:1788748617.232683:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788748617.232688:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.232694:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8adda73fec00/0x9ba0f20a02e1b8a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.232709:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748617.232710:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788748617.232712:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788748617.234119:0:17188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:214085a6-5521-4af6-bbcd-d13001081488+22:15653:x1875638368739968:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1692us (3174us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788748617.234134:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000020:00080000:2.0:1788748617.234141:0:17188:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788748617.234982:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788748617.234988:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788748617.235007:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788748617.235013:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788748617.404823:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788748617.405623:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788748617.405863:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368740096 00000100:00100000:0.0:1788748617.405872:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368740096 00000100:00100000:0.0:1788748617.405932:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638368740224 00000100:00100000:0.0:1788748617.405935:0:18697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638368740224 00000100:00100000:0.0:1788748617.405954:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1788748617.405964:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:214085a6-5521-4af6-bbcd-d13001081488+8:2412:x1875638368740096:12345-192.168.203.22@tcp:4:dd.0 00002000:00010000:0.0:1788748617.406012:0:18697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9e2349, atime: 0x6a9e2348, ctime: 0x6a9e2349, blocks: 0x0 00010000:00010000:0.0:1788748617.406021:0:18697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.406037:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=534s v=(0 0) 00010000:00010000:0.0:1788748617.406041:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788748617.406074:0:18697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.406090:0:18697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788748617.507163:0:19505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788748617.507185:0:19505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788748617.508091:0:18697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788748617.508098:0:18697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788748617 -> 1788748618 00002000:00010000:1.0:1788748617.508100:0:18697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788748617 -> 1788748618 00002000:00010000:1.0:1788748617.508116:0:18697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788748617.508135:0:18697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508148:0:18697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508157:0:18697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508165:0:18697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add8148a800 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:1.0:1788748617.508170:0:18697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508179:0:18697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508198:0:18697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508205:0:18697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a4bf93/0x9ba0f20a02e1b8a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788748617.508371:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:214085a6-5521-4af6-bbcd-d13001081488+6:2412:x1875638368740096:12345-192.168.203.22@tcp:4:dd.0 Request processed in 102350us (103497us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788748617.508398:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788748617.508433:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1788748617.508444:0:18697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368740224:12345-192.168.203.22@tcp:4:dd.0 00002000:00010000:1.0:1788748617.508490:0:18697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a9e234a, atime: 0x6a9e2348, ctime: 0x6a9e234a, blocks: 0x2000 00010000:00010000:1.0:1788748617.508497:0:18697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508508:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=534s v=(0 0) 00010000:00010000:1.0:1788748617.508512:0:18697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788748617.508518:0:18697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788748617.508531:0:18697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788748617.572559:0:19505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1788748617.572916:0:18697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1788748617.572922:0:18697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1788748617.572939:0:18697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.572953:0:18697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.572963:0:18697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.572971:0:18697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8add813fb200 already unused, calling callback (ffffffffc0cf88d0) 00010000:00010000:0.0:1788748617.572976:0:18697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.572986:0:18697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.573006:0:18697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788748617.573014:0:18697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b87f690c/0x9ba0f20a02e1b8af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788748617.573184:0:18697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:214085a6-5521-4af6-bbcd-d13001081488+5:2413:x1875638368740224:12345-192.168.203.22@tcp:4:dd.0 Request processed in 64739us (167558us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788748617.573194:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00010000:00010000:3.0:1788748617.636488:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788748618.532549:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388728064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788748618.532740:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748618.532831:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728064 00000100:00100000:1.0:1788748618.532843:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728064 00000100:00100000:1.0:1788748618.532908:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788748618.532919:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388728064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788748618.532966:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788748618.533043:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875638388728064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748618.533052:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788748618.533085:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875638388728064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788748618.533434:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788748618.533448:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388728192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788748618.533496:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748618.533596:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728192 00000100:00100000:3.0:1788748618.533603:0:17190:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728192 00000100:00100000:3.0:1788748618.533649:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788748618.533658:0:17190:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbb0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388728192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788748618.533683:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788748618.533739:0:17190:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbb0ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875638388728192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748618.533746:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788748618.533892:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875638388728192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788748618.534639:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788748618.538426:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388728320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788748618.538535:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748618.538890:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728320 00000100:00100000:3.0:1788748618.538905:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728320 00000100:00100000:3.0:1788748618.538987:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788748618.538999:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788748618.539000:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388728320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788748618.539047:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788748618.539131:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875638388728320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748618.539148:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788748618.539211:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875638388728320:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788748618.661870:0:17173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788748618.950305:0:20362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1788748619.556644:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388728448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788748619.556729:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748619.556801:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728448 00000100:00100000:3.0:1788748619.556818:0:18695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728448 00000100:00100000:3.0:1788748619.556925:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788748619.556939:0:18695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388728448:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748619.556981:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388728704:0@lo:400:kworker.0 00002000:00000024:3.0:1788748619.556982:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788748619.557028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748619.557067:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788748619.557076:0:18695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc849a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388728448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748619.557080:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388728832:0@lo:400:kworker.0 00000100:00100000:3.0:1788748619.557099:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788748619.557118:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748619.557152:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388728576:0@lo:400:kworker.0 00000100:00100000:0.0:1788748619.557163:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728832 00000100:00100000:0.0:1788748619.557172:0:18692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728832 00000100:00100000:3.0:1788748619.557199:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748619.557237:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788748619.557250:0:18692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388728832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788748619.557252:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc82fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388729088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788748619.557295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788748619.557360:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788748619.557369:0:18692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388728832:12345-0@lo:400:kworker.0 Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748619.557373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388728960:0@lo:400:kworker.0 00000100:00100000:0.0:1788748619.557390:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788748619.557414:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748619.557447:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388728832:0@lo:400:kworker.0 00000100:00080000:3.0:1788748619.557451:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788748619.557458:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788748619.557478:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729088 00000100:00100000:3.0:1788748619.557484:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729088 00000100:00100000:0.0:1788748619.557506:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728704 00000100:00100000:0.0:1788748619.557514:0:17191:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728704 00000100:00100000:0.0:1788748619.557551:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788748619.557558:0:17191:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388728704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788748619.557602:0:17191:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875638388728704:12345-0@lo:400:kworker.0 Request processed in 44us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748619.557635:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788748619.557673:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388728448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788748619.557695:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875638388728704:0@lo:400:kworker.0 00000100:00100000:0.0:1788748619.557716:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728960 00000100:00100000:0.0:1788748619.557720:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728960 00000100:00100000:3.0:1788748619.557738:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788748619.557754:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388729088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788748619.557760:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788748619.557777:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388728960:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788748619.557780:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788748619.557839:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875638388729088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748619.557930:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788748619.557979:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788748619.558897:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875638388728960:12345-0@lo:400:kworker.0 Request processed in 1119us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748619.559015:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788748619.559114:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388729216:0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559170:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388729344:0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.559171:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748619.559206:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748619.559352:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388729856:0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559384:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388728576 00000100:00100000:2.0:1788748619.559401:0:17180:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388728576 00000100:00100000:1.0:1788748619.559435:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388729728:0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559442:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788748619.559451:0:17180:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc83856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3638:x1875638388728576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.559462:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748619.559490:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc84bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388730240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559515:0:17180:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc83856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f35c4edf-1df7-4d0c-8881-06ee23716a92+24:3638:x1875638388728576:12345-0@lo:400:kworker.0 Request processed in 64us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748619.559515:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748619.559540:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729216 00000100:00100000:1.0:1788748619.559543:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729216 00000100:00100000:1.0:1788748619.559566:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729728 00000100:00100000:1.0:1788748619.559569:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729728 00000100:00100000:1.0:1788748619.559581:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388730240 00000100:00100000:1.0:1788748619.559583:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388730240 00000100:00100000:1.0:1788748619.559604:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788748619.559610:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388729216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559643:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788748619.559664:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875638388729216:12345-0@lo:400:kworker.0 Request processed in 53us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748619.559673:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788748619.559690:0:17926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729344 00000100:00100000:1.0:1788748619.559694:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788748619.559695:0:17926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729344 00000100:00100000:1.0:1788748619.559703:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388729728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559726:0:17926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748619.559735:0:17926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbb0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388729344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.559745:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875638388729728:12345-0@lo:400:kworker.0 Request processed in 43us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748619.559753:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788748619.559771:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748619.559775:0:17926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbb0bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875638388729344:12345-0@lo:400:kworker.0 Request processed in 41us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748619.559782:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc84bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388730240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559784:0:17926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788748619.559805:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788748619.559838:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875638388729344:0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.559850:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc84bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875638388730240:12345-0@lo:400:kworker.0 Request processed in 72us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748619.559858:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788748619.559865:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729856 00000100:00100000:2.0:1788748619.559869:0:18714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729856 00000100:00080000:1.0:1788748619.559881:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748619.559887:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788748619.559897:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788748619.559905:0:18714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8addbb0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388729856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.559923:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875638388729216:0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.559937:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875638388729728:0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559943:0:18714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8addbb0b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875638388729856:12345-0@lo:400:kworker.0 Request processed in 38us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748619.559949:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788748619.559952:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc84bbf100 x1875638388730240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748619.559963:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc84bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875638388730240:0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.559985:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875638388729856:0@lo:400:kworker.0 00000100:00100000:0.0:1788748619.560541:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388729472:0@lo:400:kworker.0 00000100:00100000:0.0:1788748619.561708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748619.561758:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388729984:0@lo:400:kworker.0 00000100:00100000:0.0:1788748619.561795:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788748619.561832:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788748619.561838:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000100:00100000:0.0:1788748619.561843:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8addbb0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388729600:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788748619.561862:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8adc84950700, transno 8589934596 00000100:00100000:0.0:1788748619.561881:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788748619.561889:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788748619.561912:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8adc842f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388730112:0@lo:400:kworker.0 00000100:00100000:3.0:1788748619.561928:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388728960:0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.561936:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729984 00000100:00100000:0.0:1788748619.561943:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788748619.561945:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729984 00000100:00100000:3.0:1788748619.561958:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f35c4edf-1df7-4d0c-8881-06ee23716a92:3638:1875638388728576:0@lo:400:kworker.0 00000100:00100000:3.0:1788748619.561993:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc82fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875638388729088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788748619.562002:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388730112 00000100:00100000:1.0:1788748619.562008:0:17185:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388730112 00000100:00100000:1.0:1788748619.562039:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788748619.562047:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388729984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.562086:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875638388729984:12345-0@lo:400:kworker.0 Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788748619.562090:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788748619.562100:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788748619.562104:0:17185:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388730112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.562173:0:19687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729472 00000100:00100000:2.0:1788748619.562179:0:19687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729472 00000100:00100000:2.0:1788748619.562211:0:19687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788748619.562218:0:19687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388729472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788748619.562256:0:19687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1875638388729472:12345-0@lo:400:kworker.0 Request processed in 39us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788748619.562339:0:19687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788748619.562445:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875638388729600 00000100:00100000:3.0:1788748619.562454:0:18694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875638388729600 00000100:00100000:0.0:1788748619.562486:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc849aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875638388729472:0@lo:400:kworker.0 00010000:00080000:0.0:1788748619.562504:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8adc842faa00 x1875638388729984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788748635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788748619.562514:0:17185:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875638388730112:12345-0@lo:400:kworker.0 Request processed in 408us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788748619.562517:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875638388729984:0@lo:400:kworker.0 00000100:00100000:1.0:1788748619.562522:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788748619.562540:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788748619.562550:0:17181:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788748619.562557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8adc842f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875638388730112:0@lo:400:kworker.0 00000100:00100000:3.0:1788748619.562638:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788748619.562650:0:18694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8adc82fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388729600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788748619.562675:0:18694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788748619.562689:0:18695:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788748619.562697:0:18695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788748619.562761:0:18694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8adc82fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875638388729600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788748619.562770:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788748619.562885:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8addbb0bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875638388729600:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788748619.621480:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788748619.686462:0:17174:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41701 lines, 41701 kept, 0 dropped, 0 bad.